[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:06 dist-test-slave-7kzw krb5kdc[11559](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:06 dist-test-slave-7kzw krb5kdc[11559](info): set up 2 sockets
Aug 08 05:03:06 dist-test-slave-7kzw krb5kdc[11559](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 05:03:07.614444 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.355s user 0.006s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:07 dist-test-slave-7kzw krb5kdc[11559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:07.745831 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:42513
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:42513
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:07.832887 11580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:07.833145 11580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:07.833184 11580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:07.834312 11580 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:07.834389 11580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:07.834414 11580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:07.834434 11580 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:07.834483 11580 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:07.836165 11580 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:42513
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:42513
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:07.836591 11580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:07.836995 11580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:07.843957 11592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:07.844204 11590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:07.844570 11594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:07.845172 11580 server_base.cc:1034] running on GCE node
I20260808 05:03:07.845544 11580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:07.846015 11580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:07.847204 11580 hybrid_clock.cc:648] HybridClock initialized: now 1786165387847187 us; error 72 us; skew 500 ppm
Aug 08 05:03:07 dist-test-slave-7kzw krb5kdc[11559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165387, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:07.849874 11580 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:07.850656 11580 webserver.cc:460] Webserver started at http://127.11.70.254:44575/ using document root <none> and password file <none>
I20260808 05:03:07.850986 11580 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:07.851065 11580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:07.851276 11580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:07.852515 11580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "ee329c83a6c045c28b047a3e6dfca014"
format_stamp: "Formatted at 2026-08-08 05:03:07 on dist-test-slave-7kzw"
server_key: "3d06b60c7a8b5f96196c59cf2e4487fa"
server_key_iv: "99a9d0760195d5ccb2d1072f79d8466a"
server_key_version: "encryptionkey@0"
I20260808 05:03:07.852916 11580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "ee329c83a6c045c28b047a3e6dfca014"
format_stamp: "Formatted at 2026-08-08 05:03:07 on dist-test-slave-7kzw"
server_key: "3d06b60c7a8b5f96196c59cf2e4487fa"
server_key_iv: "99a9d0760195d5ccb2d1072f79d8466a"
server_key_version: "encryptionkey@0"
I20260808 05:03:07.854887 11580 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.003s
I20260808 05:03:07.855995 11602 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:07.856384 11580 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:07.856504 11580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "ee329c83a6c045c28b047a3e6dfca014"
format_stamp: "Formatted at 2026-08-08 05:03:07 on dist-test-slave-7kzw"
server_key: "3d06b60c7a8b5f96196c59cf2e4487fa"
server_key_iv: "99a9d0760195d5ccb2d1072f79d8466a"
server_key_version: "encryptionkey@0"
I20260808 05:03:07.856588 11580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:07.875336 11580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:07.877523 11580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:07.877723 11580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:07.883374 11580 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:42513
I20260808 05:03:07.883487 11673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:42513 every 8 connection(s)
I20260808 05:03:07.884050 11580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:07.885452 11674 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:07.888680 11674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014: Bootstrap starting.
I20260808 05:03:07.889571 11674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:07.889976 11674 log.cc:824] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:07.890901 11674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014: No bootstrap required, opened a new log
I20260808 05:03:07.891673 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 11580
I20260808 05:03:07.891817 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:07.892524 11547 external_mini_cluster.cc:1428] Setting key 172c9c2650a175bc334673e5046eadd0
I20260808 05:03:07.892889 11674 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee329c83a6c045c28b047a3e6dfca014" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42513 } }
I20260808 05:03:07.893064 11674 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:07.893143 11674 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee329c83a6c045c28b047a3e6dfca014, State: Initialized, Role: FOLLOWER
I20260808 05:03:07.893370 11674 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee329c83a6c045c28b047a3e6dfca014" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42513 } }
I20260808 05:03:07.893545 11674 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:07.893596 11674 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:07.893651 11674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:07.894894 11674 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee329c83a6c045c28b047a3e6dfca014" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42513 } }
I20260808 05:03:07.895099 11674 leader_election.cc:302] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee329c83a6c045c28b047a3e6dfca014; no voters:
I20260808 05:03:07.895329 11674 leader_election.cc:288] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:07.895359 11683 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:07.895555 11683 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [term 1 LEADER]: Becoming Leader. State: Replica: ee329c83a6c045c28b047a3e6dfca014, State: Running, Role: LEADER
I20260808 05:03:07.895846 11683 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee329c83a6c045c28b047a3e6dfca014" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42513 } }
I20260808 05:03:07.895922 11674 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:07.896566 11686 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee329c83a6c045c28b047a3e6dfca014. Latest consensus state: current_term: 1 leader_uuid: "ee329c83a6c045c28b047a3e6dfca014" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee329c83a6c045c28b047a3e6dfca014" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42513 } } }
I20260808 05:03:07.896661 11686 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:07.896600 11684 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee329c83a6c045c28b047a3e6dfca014" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee329c83a6c045c28b047a3e6dfca014" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42513 } } }
I20260808 05:03:07.896739 11684 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:07.897342 11691 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:07.898598 11691 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:07.901513 11691 catalog_manager.cc:1347] Generated new cluster ID: 922168d090274943a89f79be0925060f
I20260808 05:03:07.901597 11691 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:07.908346 11691 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:07.909238 11691 catalog_manager.cc:1504] Loading token signing keys...
Aug 08 05:03:07 dist-test-slave-7kzw krb5kdc[11559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165387, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:07.915025 11691 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee329c83a6c045c28b047a3e6dfca014: Generated new TSK 0
I20260808 05:03:07.915288 11691 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:03:07.916397 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:07.894063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56514 (local address 127.11.70.254:42513)
0808 05:03:07.894536 (+ 473us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:07.894549 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:07.895976 (+ 1427us) server_negotiation.cc:407] Connection header received
0808 05:03:07.898983 (+ 3007us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:07.898991 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:07.899092 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:07.899281 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:07.901593 (+ 2312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:07.903270 (+ 1677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:07.904950 (+ 1680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:07.905614 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:07.905715 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:07.911241 (+ 5526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:07.911246 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:07.911246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:07.911259 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:07.913565 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:07.914110 (+ 545us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:07.914113 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:07.914114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:07.914256 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:07.914673 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:07.914674 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:07.914675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:07.915012 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:07.915187 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:07.915901 (+ 714us) server_negotiation.cc:299] Negotiation successful
0808 05:03:07.916116 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":256,"thread_start_us":132,"threads_started":1}
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:07.945284 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42513
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:08.032050 11712 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:08.032286 11712 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:08.032326 11712 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:08.033454 11712 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:08.033525 11712 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:08.033572 11712 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:08.035073 11712 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42513
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11712
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:08.035409 11712 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:08.035661 11712 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:08.041208 11717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:08.041208 11720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:08.041520 11718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:08.042011 11712 server_base.cc:1034] running on GCE node
I20260808 05:03:08.042348 11712 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:08.042730 11712 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:08.043941 11712 hybrid_clock.cc:648] HybridClock initialized: now 1786165388043923 us; error 46 us; skew 500 ppm
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:08.047260 11712 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:08.047780 11712 webserver.cc:460] Webserver started at http://127.11.70.193:35411/ using document root <none> and password file <none>
I20260808 05:03:08.048025 11712 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:08.048094 11712 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:08.048249 11712 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:08.049715 11712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "142f7c7e449d49948369409f26d2ead5"
format_stamp: "Formatted at 2026-08-08 05:03:08 on dist-test-slave-7kzw"
server_key: "ae1e946db0b80e9e12c624edbbf700e6"
server_key_iv: "ed86842472f8b23418ee69bc80d755d7"
server_key_version: "encryptionkey@0"
I20260808 05:03:08.050169 11712 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "142f7c7e449d49948369409f26d2ead5"
format_stamp: "Formatted at 2026-08-08 05:03:08 on dist-test-slave-7kzw"
server_key: "ae1e946db0b80e9e12c624edbbf700e6"
server_key_iv: "ed86842472f8b23418ee69bc80d755d7"
server_key_version: "encryptionkey@0"
I20260808 05:03:08.052013 11712 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260808 05:03:08.053047 11729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:08.053244 11712 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:08.053366 11712 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "142f7c7e449d49948369409f26d2ead5"
format_stamp: "Formatted at 2026-08-08 05:03:08 on dist-test-slave-7kzw"
server_key: "ae1e946db0b80e9e12c624edbbf700e6"
server_key_iv: "ed86842472f8b23418ee69bc80d755d7"
server_key_version: "encryptionkey@0"
I20260808 05:03:08.053447 11712 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:08.067658 11712 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:08.070039 11712 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:08.070235 11712 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:08.070613 11712 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:08.071095 11712 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:08.071193 11712 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:08.071220 11712 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:08.071269 11712 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:08.080221 11712 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:33403
I20260808 05:03:08.080281 11893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:33403 every 8 connection(s)
I20260808 05:03:08.080659 11712 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:08.080991 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 11712
I20260808 05:03:08.081115 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:08.081290 11547 external_mini_cluster.cc:1428] Setting key 8434be479a9224b438ec0ec791dd2acc
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
I20260808 05:03:08.093060 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:08.081717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:35039 (local address 127.11.70.254:42513)
0808 05:03:08.081782 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:08.081784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:08.082055 (+ 271us) server_negotiation.cc:407] Connection header received
0808 05:03:08.083123 (+ 1068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:08.083124 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:08.083135 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:08.083195 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:08.084730 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.085627 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.086713 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.087059 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.087176 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:08.089885 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:08.089887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:08.089887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:08.089894 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:08.091461 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.091997 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.091998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.091998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.092053 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.092396 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.092397 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.092397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.092519 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:08.092574 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:08.092914 (+ 340us) server_negotiation.cc:299] Negotiation successful
0808 05:03:08.092989 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:03:08.093324 11897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:08.081727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:42513 (local address 127.11.70.193:35039)
0808 05:03:08.081925 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:08.081961 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:08.083003 (+ 1042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:08.083268 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:08.083273 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:08.084393 (+ 1120us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:08.084621 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:08.084626 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.085755 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.085756 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:08.086616 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:08.086619 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.087176 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.087177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:08.087299 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:08.087887 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:08.087896 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:08.089785 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:08.091558 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:08.091569 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:08.091571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:08.091908 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:08.092123 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:08.092124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:08.092125 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:08.092285 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:08.092599 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:08.092607 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:08.092783 (+ 176us) client_negotiation.cc:769] Sending connection context
0808 05:03:08.092882 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 05:03:08.093048 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":107,"threads_started":1}
I20260808 05:03:08.093931 11894 heartbeater.cc:347] Connected to a master server at 127.11.70.254:42513
I20260808 05:03:08.094056 11894 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:08.094249 11894 heartbeater.cc:511] Master 127.11.70.254:42513 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
I20260808 05:03:08.095418 11620 ts_manager.cc:194] Registered new tserver with Master: 142f7c7e449d49948369409f26d2ead5 (127.11.70.193:33403)
I20260808 05:03:08.096324 11620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:35039
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:08.113921 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42513
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:08.198801 11904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:08.199000 11904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:08.199024 11904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:08.200181 11904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:08.200224 11904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:08.200251 11904 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:08.201740 11904 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42513
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:08.201992 11904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:08.202231 11904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:08.207504 11914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:08.207590 11911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:08.207517 11912 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:08.208137 11904 server_base.cc:1034] running on GCE node
I20260808 05:03:08.208352 11904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:08.208590 11904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:08.209759 11904 hybrid_clock.cc:648] HybridClock initialized: now 1786165388209748 us; error 39 us; skew 500 ppm
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:08.212520 11904 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:08.213124 11904 webserver.cc:460] Webserver started at http://127.11.70.194:43319/ using document root <none> and password file <none>
I20260808 05:03:08.213357 11904 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:08.213425 11904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:08.213578 11904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:08.214747 11904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "6670c604dbb943dc89212fd30f6e700f"
format_stamp: "Formatted at 2026-08-08 05:03:08 on dist-test-slave-7kzw"
server_key: "048e3a368736e493b847613e56702044"
server_key_iv: "66a57408b56c5f69d59a0c196afac1e5"
server_key_version: "encryptionkey@0"
I20260808 05:03:08.215168 11904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "6670c604dbb943dc89212fd30f6e700f"
format_stamp: "Formatted at 2026-08-08 05:03:08 on dist-test-slave-7kzw"
server_key: "048e3a368736e493b847613e56702044"
server_key_iv: "66a57408b56c5f69d59a0c196afac1e5"
server_key_version: "encryptionkey@0"
I20260808 05:03:08.216503 11904 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:08.217274 11923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:08.217447 11904 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:08.217553 11904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "6670c604dbb943dc89212fd30f6e700f"
format_stamp: "Formatted at 2026-08-08 05:03:08 on dist-test-slave-7kzw"
server_key: "048e3a368736e493b847613e56702044"
server_key_iv: "66a57408b56c5f69d59a0c196afac1e5"
server_key_version: "encryptionkey@0"
I20260808 05:03:08.217624 11904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:08.233170 11904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:08.235069 11904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:08.235232 11904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:08.235535 11904 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:08.235865 11904 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:08.235920 11904 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:08.235955 11904 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:08.236001 11904 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:08.243538 11904 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:34719
I20260808 05:03:08.243584 12075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:34719 every 8 connection(s)
I20260808 05:03:08.243897 11904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:08.249588 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 11904
I20260808 05:03:08.249706 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:08.249871 11547 external_mini_cluster.cc:1428] Setting key 2ea4101cad1cceb9926d4b147c5a0a6e
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:08.254320 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:08.244591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:42757 (local address 127.11.70.254:42513)
0808 05:03:08.244666 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:08.244668 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:08.244882 (+ 214us) server_negotiation.cc:407] Connection header received
0808 05:03:08.245469 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:08.245470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:08.245489 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:08.245543 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:08.246695 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.247204 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.248238 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.248451 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.248532 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:08.250920 (+ 2388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:08.250922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:08.250922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:08.250931 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:08.252611 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.253163 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.253165 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.253165 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.253232 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.253515 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.253516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.253516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.253691 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:08.253740 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:08.254130 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 05:03:08.254223 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:03:08.254580 12082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:08.244575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:42513 (local address 127.11.70.194:42757)
0808 05:03:08.244752 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:08.244796 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:08.245348 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:08.245619 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:08.245623 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:08.246214 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:08.246596 (+ 382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:08.246601 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.247323 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.247324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:08.248143 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:08.248146 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.248540 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.248542 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:08.248675 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:08.249142 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:08.249151 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:08.250826 (+ 1675us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:08.252707 (+ 1881us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:08.252717 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:08.252719 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:08.253061 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:08.253308 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:08.253308 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:08.253309 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:08.253440 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:08.253793 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:08.253800 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:08.253966 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 05:03:08.254078 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 05:03:08.254254 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
I20260808 05:03:08.255142 12076 heartbeater.cc:347] Connected to a master server at 127.11.70.254:42513
I20260808 05:03:08.255247 12076 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:08.255437 12076 heartbeater.cc:511] Master 127.11.70.254:42513 requested a full tablet report, sending...
I20260808 05:03:08.256047 11620 ts_manager.cc:194] Registered new tserver with Master: 6670c604dbb943dc89212fd30f6e700f (127.11.70.194:34719)
I20260808 05:03:08.256934 11620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:42757
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:08.282574 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42513
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46041
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:08.372231 12085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:08.372464 12085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:08.372507 12085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:08.373627 12085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:08.373693 12085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:08.373739 12085 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:08.375221 12085 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46041
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42513
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:08.375487 12085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:08.375721 12085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:08.380928 12093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:08.380909 12092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:08.381059 12085 server_base.cc:1034] running on GCE node
W20260808 05:03:08.381192 12095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:08.381421 12085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:08.381624 12085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:08.382763 12085 hybrid_clock.cc:648] HybridClock initialized: now 1786165388382740 us; error 36 us; skew 500 ppm
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:08.385391 12085 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:08.385823 12085 webserver.cc:460] Webserver started at http://127.11.70.195:35739/ using document root <none> and password file <none>
I20260808 05:03:08.386055 12085 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:08.386102 12085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:08.386279 12085 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:08.387390 12085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "24ef662a162e4a9b9dc1a19ee4568414"
format_stamp: "Formatted at 2026-08-08 05:03:08 on dist-test-slave-7kzw"
server_key: "697cb8efe479c85baf411024704deb18"
server_key_iv: "be8a33e6eebd9215f417625ff990581b"
server_key_version: "encryptionkey@0"
I20260808 05:03:08.387845 12085 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "24ef662a162e4a9b9dc1a19ee4568414"
format_stamp: "Formatted at 2026-08-08 05:03:08 on dist-test-slave-7kzw"
server_key: "697cb8efe479c85baf411024704deb18"
server_key_iv: "be8a33e6eebd9215f417625ff990581b"
server_key_version: "encryptionkey@0"
I20260808 05:03:08.389199 12085 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:08.389928 12110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:08.390206 12085 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:08.390296 12085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "24ef662a162e4a9b9dc1a19ee4568414"
format_stamp: "Formatted at 2026-08-08 05:03:08 on dist-test-slave-7kzw"
server_key: "697cb8efe479c85baf411024704deb18"
server_key_iv: "be8a33e6eebd9215f417625ff990581b"
server_key_version: "encryptionkey@0"
I20260808 05:03:08.390349 12085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:08.410887 12085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:08.413214 12085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:08.413327 12085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:08.413573 12085 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:08.413899 12085 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:08.413940 12085 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:08.413964 12085 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:08.414009 12085 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:08.421386 12085 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:44317
I20260808 05:03:08.421427 12263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:44317 every 8 connection(s)
I20260808 05:03:08.421790 12085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:08.428370 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 12085
I20260808 05:03:08.428440 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:08.428598 11547 external_mini_cluster.cc:1428] Setting key 435692c5ce53e271856b3a0e5a67c132
I20260808 05:03:08.430920 11679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:08.422630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:55609 (local address 127.11.70.254:42513)
0808 05:03:08.422695 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:08.422697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:08.422937 (+ 240us) server_negotiation.cc:407] Connection header received
0808 05:03:08.423432 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:08.423432 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:08.423442 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:08.423495 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:08.424393 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.424883 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.425811 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.425992 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.426043 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:08.428154 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:08.428155 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:08.428156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:08.428164 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:08.429629 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.430038 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.430038 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.430039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.430093 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.430308 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.430308 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.430309 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.430398 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:08.430443 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:08.430778 (+ 335us) server_negotiation.cc:299] Negotiation successful
0808 05:03:08.430853 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:03:08.431023 12267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:08.422660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:42513 (local address 127.11.70.195:55609)
0808 05:03:08.422814 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:08.422851 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:08.423348 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:08.423547 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:08.423550 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:08.424127 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:08.424318 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:08.424323 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.424964 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.424965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:08.425730 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:08.425732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.426067 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.426067 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:08.426164 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:08.426666 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:08.426674 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:08.428068 (+ 1394us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:08.429713 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:08.429720 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:08.429722 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:08.429968 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:08.430154 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:08.430155 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:08.430155 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:08.430266 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:08.430449 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:08.430454 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:08.430627 (+ 173us) client_negotiation.cc:769] Sending connection context
0808 05:03:08.430714 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:03:08.430833 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":68,"threads_started":1}
I20260808 05:03:08.431522 12264 heartbeater.cc:347] Connected to a master server at 127.11.70.254:42513
I20260808 05:03:08.431604 12264 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:08.431737 12264 heartbeater.cc:511] Master 127.11.70.254:42513 requested a full tablet report, sending...
I20260808 05:03:08.432092 11620 ts_manager.cc:194] Registered new tserver with Master: 24ef662a162e4a9b9dc1a19ee4568414 (127.11.70.195:44317)
I20260808 05:03:08.432438 11620 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:55609
I20260808 05:03:08.440750 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:08.465816 12272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:08.457708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46990 (local address 127.11.70.193:33403)
0808 05:03:08.457891 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:08.457897 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:08.457909 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:03:08.457948 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:08.457950 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:08.457963 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:08.458049 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:08.458724 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.459550 (+ 826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.460333 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.460707 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.460804 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:08.463311 (+ 2507us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:08.463319 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:08.463319 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:08.463327 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:08.464758 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.465112 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.465115 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.465115 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.465174 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.465353 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.465353 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.465354 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.465483 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:08.465587 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:08.465668 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 05:03:08.465730 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":80,"threads_started":1}
W20260808 05:03:08.466331 11776 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46990
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[11559](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165388, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:08.489408 12272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:08.482576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47002 (local address 127.11.70.193:33403)
0808 05:03:08.482651 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:08.482653 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:08.482726 (+ 73us) server_negotiation.cc:407] Connection header received
0808 05:03:08.482768 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:08.482769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:08.482782 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:08.482840 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:08.483365 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.483836 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.484552 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:08.484743 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:08.484793 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:08.486984 (+ 2191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:08.486986 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:08.486986 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:08.486993 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:08.488438 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.488751 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.488752 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.488752 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.488805 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:08.488968 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:08.488968 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:08.488968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:08.489059 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:08.489150 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:08.489218 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 05:03:08.489288 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:03:08.489974 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 11712
I20260808 05:03:08.500582 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 11904
I20260808 05:03:08.516611 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 12085
I20260808 05:03:08.525004 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 11580
2026-08-08T05:03:08Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2294 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[12286](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[12286](info): set up 2 sockets
Aug 08 05:03:08 dist-test-slave-7kzw krb5kdc[12286](info): commencing operation
krb5kdc: starting...
W20260808 05:03:09.749250 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:09 dist-test-slave-7kzw krb5kdc[12286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165389, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:09.870677 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:45197
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:45197
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:09.954417 12303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:09.954684 12303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:09.954731 12303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:09.956241 12303 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:09.956300 12303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:09.956323 12303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:09.956343 12303 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:09.956363 12303 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:09.958922 12303 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:45197
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:45197
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:09.959244 12303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:09.959522 12303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:09.965111 12312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:09.965111 12316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:09.965134 12313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:09.965782 12303 server_base.cc:1034] running on GCE node
I20260808 05:03:09.966039 12303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:09.966361 12303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:09.967549 12303 hybrid_clock.cc:648] HybridClock initialized: now 1786165389967536 us; error 45 us; skew 500 ppm
Aug 08 05:03:09 dist-test-slave-7kzw krb5kdc[12286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165389, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:09.970157 12303 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:09.970613 12303 webserver.cc:460] Webserver started at http://127.11.70.254:46789/ using document root <none> and password file <none>
I20260808 05:03:09.970813 12303 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:09.970856 12303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:09.970952 12303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:09.972040 12303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "3bd0e5f6d2174fd8af4926426dfd1029"
format_stamp: "Formatted at 2026-08-08 05:03:09 on dist-test-slave-7kzw"
server_key: "2ebc1ad2d0ff91bb77a155eadef7af24"
server_key_iv: "439cbbd442336594e37fa1d1e62459d2"
server_key_version: "encryptionkey@0"
I20260808 05:03:09.972362 12303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "3bd0e5f6d2174fd8af4926426dfd1029"
format_stamp: "Formatted at 2026-08-08 05:03:09 on dist-test-slave-7kzw"
server_key: "2ebc1ad2d0ff91bb77a155eadef7af24"
server_key_iv: "439cbbd442336594e37fa1d1e62459d2"
server_key_version: "encryptionkey@0"
I20260808 05:03:09.973683 12303 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:09.974365 12324 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:09.974553 12303 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:09.974647 12303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "3bd0e5f6d2174fd8af4926426dfd1029"
format_stamp: "Formatted at 2026-08-08 05:03:09 on dist-test-slave-7kzw"
server_key: "2ebc1ad2d0ff91bb77a155eadef7af24"
server_key_iv: "439cbbd442336594e37fa1d1e62459d2"
server_key_version: "encryptionkey@0"
I20260808 05:03:09.974704 12303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:10.007504 12303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:10.009485 12303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:10.009599 12303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:10.013746 12303 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:45197
I20260808 05:03:10.013805 12399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:45197 every 8 connection(s)
I20260808 05:03:10.014168 12303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:10.015220 12400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:10.015625 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 12303
I20260808 05:03:10.015739 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:10.015913 11547 external_mini_cluster.cc:1428] Setting key 049630f8fad5bb915d8b7fc0f4dd850e
I20260808 05:03:10.018567 12400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029: Bootstrap starting.
I20260808 05:03:10.019345 12400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:10.019713 12400 log.cc:824] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:10.020515 12400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029: No bootstrap required, opened a new log
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165389, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:10.023597 12400 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd0e5f6d2174fd8af4926426dfd1029" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45197 } }
I20260808 05:03:10.023775 12400 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:10.023857 12400 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bd0e5f6d2174fd8af4926426dfd1029, State: Initialized, Role: FOLLOWER
I20260808 05:03:10.024035 12400 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd0e5f6d2174fd8af4926426dfd1029" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45197 } }
I20260808 05:03:10.024137 12400 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:10.024175 12400 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:10.024222 12400 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:10.024979 12400 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd0e5f6d2174fd8af4926426dfd1029" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45197 } }
I20260808 05:03:10.025120 12400 leader_election.cc:302] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bd0e5f6d2174fd8af4926426dfd1029; no voters:
I20260808 05:03:10.025364 12400 leader_election.cc:288] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:10.025417 12407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:10.025549 12407 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [term 1 LEADER]: Becoming Leader. State: Replica: 3bd0e5f6d2174fd8af4926426dfd1029, State: Running, Role: LEADER
I20260808 05:03:10.025646 12407 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd0e5f6d2174fd8af4926426dfd1029" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45197 } }
I20260808 05:03:10.025715 12400 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:10.026002 12407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bd0e5f6d2174fd8af4926426dfd1029. Latest consensus state: current_term: 1 leader_uuid: "3bd0e5f6d2174fd8af4926426dfd1029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd0e5f6d2174fd8af4926426dfd1029" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45197 } } }
I20260808 05:03:10.026086 12407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:10.027521 12404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.016468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33576 (local address 127.11.70.254:45197)
0808 05:03:10.016666 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.016674 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.016703 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:03:10.017105 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.017112 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.017156 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.017284 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:10.018113 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.019126 (+ 1013us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.020279 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.020733 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.020819 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.023640 (+ 2821us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:10.023645 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:10.023645 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:10.023656 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:10.025832 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.026212 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.026215 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.026216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.026326 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.026554 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.026555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.026555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.026850 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:10.027026 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.027110 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.027278 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":88,"threads_started":1}
I20260808 05:03:10.026307 12409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bd0e5f6d2174fd8af4926426dfd1029" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bd0e5f6d2174fd8af4926426dfd1029" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45197 } } }
I20260808 05:03:10.027928 12409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029 [sys.catalog]: This master's current role is: LEADER
W20260808 05:03:10.028419 12428 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:03:10.028486 12428 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:03:10.028607 12414 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:10.028774 12414 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:10.030341 12414 catalog_manager.cc:1347] Generated new cluster ID: 66bf3d07bbf249f0aa18562b8af46016
I20260808 05:03:10.030405 12414 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:10.051203 12414 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:10.051764 12414 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:10.059149 12414 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3bd0e5f6d2174fd8af4926426dfd1029: Generated new TSK 0
I20260808 05:03:10.059331 12414 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:10.091619 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45197
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:10.187722 12434 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:10.187928 12434 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:10.187952 12434 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:10.189079 12434 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:10.189121 12434 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:10.189168 12434 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:10.190650 12434 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45197
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12434
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:10.190897 12434 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:10.191126 12434 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:10.196277 12444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:10.196277 12440 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:10.196440 12442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:10.196789 12434 server_base.cc:1034] running on GCE node
I20260808 05:03:10.197047 12434 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:10.197300 12434 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:10.198501 12434 hybrid_clock.cc:648] HybridClock initialized: now 1786165390198488 us; error 27 us; skew 500 ppm
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:10.201185 12434 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:10.201646 12434 webserver.cc:460] Webserver started at http://127.11.70.193:45961/ using document root <none> and password file <none>
I20260808 05:03:10.201877 12434 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:10.201948 12434 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:10.202103 12434 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:10.203209 12434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "f863a7e153524fbaa0bbc68d0dc1eba2"
format_stamp: "Formatted at 2026-08-08 05:03:10 on dist-test-slave-7kzw"
server_key: "44e75b7123b9d13d67989bbc59b6a7eb"
server_key_iv: "9367ca9848b3a50b2587e5967d9100bc"
server_key_version: "encryptionkey@0"
I20260808 05:03:10.203598 12434 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "f863a7e153524fbaa0bbc68d0dc1eba2"
format_stamp: "Formatted at 2026-08-08 05:03:10 on dist-test-slave-7kzw"
server_key: "44e75b7123b9d13d67989bbc59b6a7eb"
server_key_iv: "9367ca9848b3a50b2587e5967d9100bc"
server_key_version: "encryptionkey@0"
I20260808 05:03:10.205054 12434 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:10.205906 12455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:10.206095 12434 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:10.206207 12434 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "f863a7e153524fbaa0bbc68d0dc1eba2"
format_stamp: "Formatted at 2026-08-08 05:03:10 on dist-test-slave-7kzw"
server_key: "44e75b7123b9d13d67989bbc59b6a7eb"
server_key_iv: "9367ca9848b3a50b2587e5967d9100bc"
server_key_version: "encryptionkey@0"
I20260808 05:03:10.206296 12434 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:10.229399 12434 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:10.231906 12434 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:10.232085 12434 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:10.232354 12434 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:10.232697 12434 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:10.232760 12434 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:10.232806 12434 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:10.232836 12434 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:10.238869 12434 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:42563
I20260808 05:03:10.238968 12615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:42563 every 8 connection(s)
I20260808 05:03:10.239300 12434 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:10.248200 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 12434
I20260808 05:03:10.248328 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:10.248490 11547 external_mini_cluster.cc:1428] Setting key 6ecd715b0993fb174db2b196739c8dc1
I20260808 05:03:10.249083 12404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.240111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:52927 (local address 127.11.70.254:45197)
0808 05:03:10.240227 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.240229 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.240431 (+ 202us) server_negotiation.cc:407] Connection header received
0808 05:03:10.241455 (+ 1024us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.241457 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.241468 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.241540 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:10.242124 (+ 584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.242741 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.243729 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.243960 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.244044 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.246203 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:10.246205 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:10.246205 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:10.246213 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:10.247536 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.247987 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.247988 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.247988 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.248072 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.248416 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.248417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.248417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.248530 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:10.248605 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.248896 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.248989 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260808 05:03:10.249264 12621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.240075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:45197 (local address 127.11.70.193:52927)
0808 05:03:10.240242 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:10.240285 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:10.241346 (+ 1061us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:10.241595 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:10.241598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:10.241852 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:10.242040 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.242043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.242824 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.242824 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.243629 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.243631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.244045 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.244046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.244146 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.244698 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:10.244706 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:10.246113 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:10.247629 (+ 1516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:10.247636 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:10.247638 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:10.247880 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:10.248169 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:10.248171 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:10.248171 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:10.248295 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:10.248608 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:10.248616 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:10.248761 (+ 145us) client_negotiation.cc:769] Sending connection context
0808 05:03:10.248872 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 05:03:10.249027 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":88,"threads_started":1}
I20260808 05:03:10.249784 12617 heartbeater.cc:347] Connected to a master server at 127.11.70.254:45197
I20260808 05:03:10.249895 12617 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:10.250116 12617 heartbeater.cc:511] Master 127.11.70.254:45197 requested a full tablet report, sending...
I20260808 05:03:10.250725 12349 ts_manager.cc:194] Registered new tserver with Master: f863a7e153524fbaa0bbc68d0dc1eba2 (127.11.70.193:42563)
I20260808 05:03:10.251367 12349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:52927
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:10.275717 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45197
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:10.358583 12624 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:10.358785 12624 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:10.358808 12624 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:10.359910 12624 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:10.359944 12624 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:10.359970 12624 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:10.361375 12624 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45197
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12624
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:10.361603 12624 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:10.361820 12624 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:10.366881 12636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:10.366886 12632 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:10.366897 12633 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:10.367141 12624 server_base.cc:1034] running on GCE node
I20260808 05:03:10.367352 12624 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:10.367607 12624 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:10.368794 12624 hybrid_clock.cc:648] HybridClock initialized: now 1786165390368781 us; error 52 us; skew 500 ppm
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:10.371435 12624 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:10.371898 12624 webserver.cc:460] Webserver started at http://127.11.70.194:45399/ using document root <none> and password file <none>
I20260808 05:03:10.372121 12624 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:10.372189 12624 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:10.372340 12624 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:10.373350 12624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6"
format_stamp: "Formatted at 2026-08-08 05:03:10 on dist-test-slave-7kzw"
server_key: "54bd9111a7606123f26e3bf0a4075ddd"
server_key_iv: "77a668dc8b36e035d0a55404cd13ccef"
server_key_version: "encryptionkey@0"
I20260808 05:03:10.373720 12624 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6"
format_stamp: "Formatted at 2026-08-08 05:03:10 on dist-test-slave-7kzw"
server_key: "54bd9111a7606123f26e3bf0a4075ddd"
server_key_iv: "77a668dc8b36e035d0a55404cd13ccef"
server_key_version: "encryptionkey@0"
I20260808 05:03:10.375222 12624 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:10.375989 12645 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:10.376206 12624 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:10.376315 12624 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6"
format_stamp: "Formatted at 2026-08-08 05:03:10 on dist-test-slave-7kzw"
server_key: "54bd9111a7606123f26e3bf0a4075ddd"
server_key_iv: "77a668dc8b36e035d0a55404cd13ccef"
server_key_version: "encryptionkey@0"
I20260808 05:03:10.376389 12624 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:10.410041 12624 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:10.412091 12624 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:10.412269 12624 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:10.412528 12624 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:10.412843 12624 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:10.412899 12624 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:10.412935 12624 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:10.412962 12624 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:10.419270 12624 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:41229
I20260808 05:03:10.419324 12795 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:41229 every 8 connection(s)
I20260808 05:03:10.419626 12624 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:10.421528 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 12624
I20260808 05:03:10.421641 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:10.421823 11547 external_mini_cluster.cc:1428] Setting key 7e97bb3b8d4a4b09d84411da8e2d77f7
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:10.429850 12404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.420301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:39891 (local address 127.11.70.254:45197)
0808 05:03:10.420372 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.420374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.420564 (+ 190us) server_negotiation.cc:407] Connection header received
0808 05:03:10.421483 (+ 919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.421484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.421498 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.421557 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:10.422364 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.422956 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.423967 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.424167 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.424242 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.426952 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:10.426954 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:10.426954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:10.426961 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:10.428426 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.428869 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.428870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.428871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.428935 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.429197 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.429198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.429198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.429316 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:10.429395 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.429667 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.429754 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:03:10.430058 12800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.420284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:45197 (local address 127.11.70.194:39891)
0808 05:03:10.420441 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:10.420477 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:10.421356 (+ 879us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:10.421640 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:10.421644 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:10.421999 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:10.422271 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.422277 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.423056 (+ 779us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.423057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.423865 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.423867 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.424251 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.424252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.424384 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.424889 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:10.424898 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:10.426865 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:10.428531 (+ 1666us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:10.428538 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:10.428540 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:10.428776 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:10.429010 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:10.429010 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:10.429011 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:10.429124 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:10.429386 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:10.429393 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:10.429535 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 05:03:10.429645 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 05:03:10.429813 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":90,"threads_started":1}
I20260808 05:03:10.430714 12798 heartbeater.cc:347] Connected to a master server at 127.11.70.254:45197
I20260808 05:03:10.430826 12798 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:10.431006 12798 heartbeater.cc:511] Master 127.11.70.254:45197 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
I20260808 05:03:10.431438 12349 ts_manager.cc:194] Registered new tserver with Master: c4fd4732ee4c4e93af2cbf9d17c712a6 (127.11.70.194:41229)
I20260808 05:03:10.431809 12349 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:39891
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:10.449352 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45197
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41027
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:10.533142 12804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:10.533347 12804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:10.533371 12804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:10.534600 12804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:10.534644 12804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:10.534672 12804 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:10.536100 12804 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41027
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45197
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12804
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:10.536275 12804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:10.536453 12804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:10.541534 12812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:10.541522 12814 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:10.541540 12816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:10.541849 12804 server_base.cc:1034] running on GCE node
I20260808 05:03:10.542110 12804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:10.542344 12804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:10.543495 12804 hybrid_clock.cc:648] HybridClock initialized: now 1786165390543493 us; error 67 us; skew 500 ppm
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:10.546064 12804 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:10.546598 12804 webserver.cc:460] Webserver started at http://127.11.70.195:40033/ using document root <none> and password file <none>
I20260808 05:03:10.546830 12804 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:10.546898 12804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:10.547032 12804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:10.548091 12804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4"
format_stamp: "Formatted at 2026-08-08 05:03:10 on dist-test-slave-7kzw"
server_key: "2837bfbcd3054db6a775bc81f30da757"
server_key_iv: "956876a274a19667ab2f26162e8fbb8e"
server_key_version: "encryptionkey@0"
I20260808 05:03:10.548516 12804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4"
format_stamp: "Formatted at 2026-08-08 05:03:10 on dist-test-slave-7kzw"
server_key: "2837bfbcd3054db6a775bc81f30da757"
server_key_iv: "956876a274a19667ab2f26162e8fbb8e"
server_key_version: "encryptionkey@0"
I20260808 05:03:10.549902 12804 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:10.550676 12824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:10.550851 12804 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:10.550961 12804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4"
format_stamp: "Formatted at 2026-08-08 05:03:10 on dist-test-slave-7kzw"
server_key: "2837bfbcd3054db6a775bc81f30da757"
server_key_iv: "956876a274a19667ab2f26162e8fbb8e"
server_key_version: "encryptionkey@0"
I20260808 05:03:10.551034 12804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:10.565692 12804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:10.567562 12804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:10.567719 12804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:10.567935 12804 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:10.568239 12804 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:10.568295 12804 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:10.568336 12804 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:10.568363 12804 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:10.574919 12804 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:41753
I20260808 05:03:10.574970 12976 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:41753 every 8 connection(s)
I20260808 05:03:10.575273 12804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:10.584666 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 12804
I20260808 05:03:10.584771 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:10.584944 11547 external_mini_cluster.cc:1428] Setting key 021d9596f92f679c8d5f96abd9278d7d
I20260808 05:03:10.585201 12404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.576019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:35421 (local address 127.11.70.254:45197)
0808 05:03:10.576102 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.576105 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.576317 (+ 212us) server_negotiation.cc:407] Connection header received
0808 05:03:10.577378 (+ 1061us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.577379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.577390 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.577434 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:10.578059 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.578709 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.579815 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.580037 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.580103 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.582223 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:10.582225 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:10.582225 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:10.582233 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:10.583704 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.584176 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.584177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.584177 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.584238 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.584523 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.584526 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.584527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.584648 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:10.584726 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.585024 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.585107 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 05:03:10.585446 12980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.575970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:45197 (local address 127.11.70.195:35421)
0808 05:03:10.576156 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:10.576194 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:10.577259 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:10.577489 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:10.577492 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:10.577748 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:10.577968 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.577974 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.578792 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.578793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.579737 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.579740 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.580129 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.580130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.580233 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.580688 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:10.580696 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:10.582122 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:10.583804 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:10.583811 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:10.583813 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:10.584077 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:10.584312 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:10.584313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:10.584313 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:10.584427 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:10.584716 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:10.584724 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:10.584877 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 05:03:10.585000 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 05:03:10.585167 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":109,"threads_started":1}
I20260808 05:03:10.585886 12977 heartbeater.cc:347] Connected to a master server at 127.11.70.254:45197
I20260808 05:03:10.585987 12977 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:10.586164 12977 heartbeater.cc:511] Master 127.11.70.254:45197 requested a full tablet report, sending...
I20260808 05:03:10.586581 12348 ts_manager.cc:194] Registered new tserver with Master: f4ea68088d5e4eeb8d8ccd44d268d6d4 (127.11.70.195:41753)
I20260808 05:03:10.586987 12348 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:35421
I20260808 05:03:10.597071 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:03:10.605358 12404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.599073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33590 (local address 127.11.70.254:45197)
0808 05:03:10.599121 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.599123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.599284 (+ 161us) server_negotiation.cc:407] Connection header received
0808 05:03:10.599313 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.599314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.599326 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.599414 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:10.600314 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.600772 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.601454 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.601631 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.601712 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.602919 (+ 1207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:10.602920 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:10.602920 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:10.602926 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:10.604377 (+ 1451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.604730 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.604731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.604731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.604783 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.604953 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.604954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.604954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.605082 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:10.605159 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.605243 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.605298 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:10.608481 12348 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33590:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:10.610446 12348 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:10.617902 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.613631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39764 (local address 127.11.70.194:41229)
0808 05:03:10.614052 (+ 421us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.614055 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.614064 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:10.614100 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.614104 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.614117 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.614203 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:10.614444 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.615321 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.616969 (+ 1648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.617460 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.617559 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.617621 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.617783 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.617824 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":77,"threads_started":1}
I20260808 05:03:10.617897 12991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.613445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:41229 (local address 127.0.0.1:39764)
0808 05:03:10.613582 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:10.613621 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:10.613688 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:10.614217 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:10.614220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:10.614222 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:10.614316 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.614319 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.615426 (+ 1107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.615427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.616890 (+ 1463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.616892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.617564 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.617565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.617649 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.617662 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 05:03:10.617764 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 05:03:10.617823 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"mutex_wait_us":47,"thread_start_us":86,"threads_started":1}
I20260808 05:03:10.618047 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.613820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53482 (local address 127.11.70.193:42563)
0808 05:03:10.613997 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.614003 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.614015 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:03:10.614060 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.614063 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.614080 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.614173 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:10.614513 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.615367 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.616860 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.617578 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.617659 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.617710 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.617909 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.617953 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260808 05:03:10.618263 12997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.613478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42563 (local address 127.0.0.1:53482)
0808 05:03:10.613849 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:10.613860 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:10.613909 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:10.614217 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:10.614220 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:10.614224 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:10.614316 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.614318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.615502 (+ 1184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.615503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.616785 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.616788 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.617747 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.617748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.617814 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.617818 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:10.618141 (+ 323us) client_negotiation.cc:240] Negotiation successful
0808 05:03:10.618192 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":351,"mutex_wait_us":122,"thread_start_us":100,"threads_started":1}
I20260808 05:03:10.619127 12993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.613731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:41753 (local address 127.0.0.1:54432)
0808 05:03:10.614319 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:10.614330 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:10.614399 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:10.615567 (+ 1168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:10.615568 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:10.615570 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:10.615740 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.615742 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.616560 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.616561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.617753 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.617755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.618899 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.618900 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.618951 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.618954 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:10.619021 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:03:10.619062 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":566,"mutex_wait_us":100,"thread_start_us":76,"threads_started":1}
I20260808 05:03:10.619161 13001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.613827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54432 (local address 127.11.70.195:41753)
0808 05:03:10.614342 (+ 515us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.614359 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.614390 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:03:10.615457 (+ 1067us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.615459 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.615472 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.615569 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:10.615815 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.616456 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.617839 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.618746 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.618816 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.618869 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.619049 (+ 180us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.619088 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":96,"threads_started":1}
I20260808 05:03:10.619181 12513 tablet_service.cc:1467] Processing CreateTablet for tablet c55edb39dfc54e1599bf056c42e95646 (DEFAULT_TABLE table=test-table [id=d004a325d7b940b1aa543860369e7027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:10.619210 12705 tablet_service.cc:1467] Processing CreateTablet for tablet c55edb39dfc54e1599bf056c42e95646 (DEFAULT_TABLE table=test-table [id=d004a325d7b940b1aa543860369e7027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:10.619577 12705 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c55edb39dfc54e1599bf056c42e95646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:10.619577 12513 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c55edb39dfc54e1599bf056c42e95646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:10.623217 12888 tablet_service.cc:1467] Processing CreateTablet for tablet c55edb39dfc54e1599bf056c42e95646 (DEFAULT_TABLE table=test-table [id=d004a325d7b940b1aa543860369e7027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:10.623327 13003 tablet_bootstrap.cc:492] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6: Bootstrap starting.
I20260808 05:03:10.623590 12888 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c55edb39dfc54e1599bf056c42e95646. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:10.624087 13003 tablet_bootstrap.cc:654] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:10.624688 13003 log.cc:824] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:10.625427 13003 tablet_bootstrap.cc:492] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6: No bootstrap required, opened a new log
I20260808 05:03:10.625483 13003 ts_tablet_manager.cc:1397] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:10.626291 13006 tablet_bootstrap.cc:492] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2: Bootstrap starting.
I20260808 05:03:10.626586 13007 tablet_bootstrap.cc:492] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4: Bootstrap starting.
I20260808 05:03:10.627170 13006 tablet_bootstrap.cc:654] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:10.627265 13007 tablet_bootstrap.cc:654] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:10.627624 13003 raft_consensus.cc:348] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } }
I20260808 05:03:10.627804 13003 raft_consensus.cc:374] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:10.627849 13003 raft_consensus.cc:729] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4fd4732ee4c4e93af2cbf9d17c712a6, State: Initialized, Role: FOLLOWER
I20260808 05:03:10.627962 13003 consensus_queue.cc:260] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } }
I20260808 05:03:10.628033 13006 log.cc:824] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:10.628033 13007 log.cc:824] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:10.628253 13003 ts_tablet_manager.cc:1428] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:03:10.628458 12798 heartbeater.cc:503] Master 127.11.70.254:45197 was elected leader, sending a full tablet report...
I20260808 05:03:10.629125 13007 tablet_bootstrap.cc:492] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4: No bootstrap required, opened a new log
I20260808 05:03:10.629140 13006 tablet_bootstrap.cc:492] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2: No bootstrap required, opened a new log
I20260808 05:03:10.629215 13006 ts_tablet_manager.cc:1397] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:03:10.629208 13007 ts_tablet_manager.cc:1397] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:03:10.630899 13007 raft_consensus.cc:348] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } }
I20260808 05:03:10.631029 13007 raft_consensus.cc:374] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:10.631052 13007 raft_consensus.cc:729] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4ea68088d5e4eeb8d8ccd44d268d6d4, State: Initialized, Role: FOLLOWER
I20260808 05:03:10.631006 13006 raft_consensus.cc:348] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } }
I20260808 05:03:10.631222 13006 raft_consensus.cc:374] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:10.631191 13007 consensus_queue.cc:260] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } }
I20260808 05:03:10.631273 13006 raft_consensus.cc:729] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f863a7e153524fbaa0bbc68d0dc1eba2, State: Initialized, Role: FOLLOWER
I20260808 05:03:10.631388 13006 consensus_queue.cc:260] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } }
I20260808 05:03:10.631469 13007 ts_tablet_manager.cc:1428] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:03:10.631507 12977 heartbeater.cc:503] Master 127.11.70.254:45197 was elected leader, sending a full tablet report...
I20260808 05:03:10.631923 13006 ts_tablet_manager.cc:1428] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:03:10.631951 12617 heartbeater.cc:503] Master 127.11.70.254:45197 was elected leader, sending a full tablet report...
W20260808 05:03:10.670177 12799 tablet.cc:2369] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:10.730753 13012 raft_consensus.cc:482] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:10.730890 13012 raft_consensus.cc:504] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } }
I20260808 05:03:10.731467 13012 leader_election.cc:288] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c4fd4732ee4c4e93af2cbf9d17c712a6 (127.11.70.194:41229), f863a7e153524fbaa0bbc68d0dc1eba2 (127.11.70.193:42563)
I20260808 05:03:10.734537 12995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.731782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:37739 (local address 127.11.70.194:41229)
0808 05:03:10.731844 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.731847 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.731858 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:10.731889 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.731890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.731900 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.731997 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:10.732185 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.732808 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.733764 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.734150 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.734238 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.734248 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.734409 (+ 161us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.734447 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:03:10.734529 12980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.731656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:41229 (local address 127.11.70.195:37739)
0808 05:03:10.731732 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:10.731748 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:10.731799 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:10.732004 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:10.732005 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:10.732008 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:10.732087 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.732089 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.732893 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.732895 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.733667 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.733669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.734237 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.734238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.734322 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.734325 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:10.734390 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:03:10.734432 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 05:03:10.734719 13014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.731784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42563 (local address 127.11.70.195:42805)
0808 05:03:10.732031 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:10.732040 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:10.732133 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:10.732326 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:10.732327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:10.732329 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:10.732409 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.732411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.733059 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.733060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.733825 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:10.733827 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.734384 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.734385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:10.734511 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.734516 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:03:10.734588 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 05:03:10.734627 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"thread_start_us":160,"threads_started":1}
I20260808 05:03:10.734705 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.731951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:42805 (local address 127.11.70.193:42563)
0808 05:03:10.731999 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.732001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.732124 (+ 123us) server_negotiation.cc:407] Connection header received
0808 05:03:10.732250 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.732252 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.732264 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.732320 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:10.732503 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.732970 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.733917 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.734296 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.734383 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.734391 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.734594 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.734635 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:03:10.735030 12732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c55edb39dfc54e1599bf056c42e95646" candidate_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" is_pre_election: true
I20260808 05:03:10.735105 12543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c55edb39dfc54e1599bf056c42e95646" candidate_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" is_pre_election: true
I20260808 05:03:10.735282 12543 raft_consensus.cc:2454] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ea68088d5e4eeb8d8ccd44d268d6d4 in term 0.
I20260808 05:03:10.735281 12732 raft_consensus.cc:2454] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4ea68088d5e4eeb8d8ccd44d268d6d4 in term 0.
I20260808 05:03:10.735594 12829 leader_election.cc:302] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f4ea68088d5e4eeb8d8ccd44d268d6d4, f863a7e153524fbaa0bbc68d0dc1eba2; no voters:
I20260808 05:03:10.735757 13012 raft_consensus.cc:2781] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:10.735862 13012 raft_consensus.cc:482] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:10.735909 13012 raft_consensus.cc:3037] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:10.736747 13012 raft_consensus.cc:504] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } }
I20260808 05:03:10.736903 13012 leader_election.cc:288] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [CANDIDATE]: Term 1 election: Requested vote from peers c4fd4732ee4c4e93af2cbf9d17c712a6 (127.11.70.194:41229), f863a7e153524fbaa0bbc68d0dc1eba2 (127.11.70.193:42563)
I20260808 05:03:10.737082 12543 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c55edb39dfc54e1599bf056c42e95646" candidate_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2"
I20260808 05:03:10.737161 12543 raft_consensus.cc:3037] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:10.737895 12543 raft_consensus.cc:2454] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ea68088d5e4eeb8d8ccd44d268d6d4 in term 1.
I20260808 05:03:10.738075 12829 leader_election.cc:302] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f4ea68088d5e4eeb8d8ccd44d268d6d4, f863a7e153524fbaa0bbc68d0dc1eba2; no voters:
I20260808 05:03:10.738233 13012 raft_consensus.cc:2781] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:10.738435 13012 raft_consensus.cc:686] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [term 1 LEADER]: Becoming Leader. State: Replica: f4ea68088d5e4eeb8d8ccd44d268d6d4, State: Running, Role: LEADER
I20260808 05:03:10.738446 12732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c55edb39dfc54e1599bf056c42e95646" candidate_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6"
I20260808 05:03:10.738562 12732 raft_consensus.cc:3037] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:10.738570 13012 consensus_queue.cc:237] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } }
I20260808 05:03:10.739595 12732 raft_consensus.cc:2454] T c55edb39dfc54e1599bf056c42e95646 P c4fd4732ee4c4e93af2cbf9d17c712a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4ea68088d5e4eeb8d8ccd44d268d6d4 in term 1.
I20260808 05:03:10.739549 12349 catalog_manager.cc:5495] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to f4ea68088d5e4eeb8d8ccd44d268d6d4 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c4fd4732ee4c4e93af2cbf9d17c712a6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f863a7e153524fbaa0bbc68d0dc1eba2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42563 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f4ea68088d5e4eeb8d8ccd44d268d6d4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 41753 } health_report { overall_health: HEALTHY } } }
W20260808 05:03:10.740013 12619 tablet.cc:2369] T c55edb39dfc54e1599bf056c42e95646 P f863a7e153524fbaa0bbc68d0dc1eba2: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165389, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:10.769881 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.762391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53484 (local address 127.11.70.193:42563)
0808 05:03:10.762482 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.762484 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.762584 (+ 100us) server_negotiation.cc:407] Connection header received
0808 05:03:10.762678 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.762679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.762692 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.762766 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:10.763336 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.763804 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.764522 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.764718 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.764823 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.767179 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:10.767190 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:10.767191 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:10.767206 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:10.768664 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.769031 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.769035 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.769036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.769115 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.769318 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.769319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.769320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.769471 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:10.769644 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.769685 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.769770 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:10.794624 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.788031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53488 (local address 127.11.70.193:42563)
0808 05:03:10.788118 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.788120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.788162 (+ 42us) server_negotiation.cc:407] Connection header received
0808 05:03:10.788211 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.788212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.788221 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.788273 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:10.788786 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.789250 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.789914 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.790095 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.790146 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.792311 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:10.792313 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:10.792313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:10.792319 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:10.793576 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.793887 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.793888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.793888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.793940 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.794101 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.794101 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.794102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.794186 (+ 84us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:10.794257 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.794391 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.794452 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[12286](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165390, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:10.818928 12998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:10.811735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53490 (local address 127.11.70.193:42563)
0808 05:03:10.811811 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:10.811813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:10.811853 (+ 40us) server_negotiation.cc:407] Connection header received
0808 05:03:10.811900 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:10.811901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:10.811911 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:10.811962 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:10.812493 (+ 531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.813009 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.813722 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:10.813925 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:10.813995 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:10.816268 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:10.816269 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:10.816270 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:10.816276 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:10.817586 (+ 1310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.817894 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.817895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.817896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.817953 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:10.818233 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:10.818234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:10.818234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:10.818353 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:10.818453 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:10.818703 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 05:03:10.818774 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
W20260808 05:03:10.819780 12490 tablet_service.cc:2908] Rejecting scan request for tablet c55edb39dfc54e1599bf056c42e95646: Uninitialized: clean time has not yet been initialized
I20260808 05:03:10.820896 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 12434
W20260808 05:03:10.825950 12979 tablet.cc:2369] T c55edb39dfc54e1599bf056c42e95646 P f4ea68088d5e4eeb8d8ccd44d268d6d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:10.834748 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 12624
I20260808 05:03:10.849871 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 12804
I20260808 05:03:10.861727 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 12303
2026-08-08T05:03:10Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2340 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[13032](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[13032](info): set up 2 sockets
Aug 08 05:03:10 dist-test-slave-7kzw krb5kdc[13032](info): commencing operation
krb5kdc: starting...
W20260808 05:03:12.138434 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.250s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:12.269695 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:33679
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:33679
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:12.354929 13049 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:12.355165 13049 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:12.355201 13049 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:12.356335 13049 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:12.356401 13049 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 05:03:12.356423 13049 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:12.356446 13049 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:12.356474 13049 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:12.356498 13049 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:12.357970 13049 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:33679
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:33679
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:12.358249 13049 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:12.358489 13049 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:12.363384 13058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:12.363437 13049 server_base.cc:1034] running on GCE node
W20260808 05:03:12.363405 13060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:12.363384 13057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:12.363909 13049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:12.364202 13049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:12.365346 13049 hybrid_clock.cc:648] HybridClock initialized: now 1786165392365357 us; error 50 us; skew 500 ppm
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:12.371156 13049 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:12.371603 13049 webserver.cc:460] Webserver started at http://127.11.70.254:40433/ using document root <none> and password file <none>
I20260808 05:03:12.371846 13049 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:12.371917 13049 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:12.372072 13049 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:12.373133 13049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "6730dadbfc974f4383bd7d51365a7038"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "df7ae17496f7d5b25aa5cd3bfc78b366"
server_key_iv: "915288880528d68a77c455801866ddac"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.373493 13049 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "6730dadbfc974f4383bd7d51365a7038"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "df7ae17496f7d5b25aa5cd3bfc78b366"
server_key_iv: "915288880528d68a77c455801866ddac"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.374886 13049 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:12.375662 13071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:12.375849 13049 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:12.375958 13049 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "6730dadbfc974f4383bd7d51365a7038"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "df7ae17496f7d5b25aa5cd3bfc78b366"
server_key_iv: "915288880528d68a77c455801866ddac"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.376034 13049 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:12.387458 13049 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:12.389768 13049 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:12.389932 13049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:12.395227 13049 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:33679
I20260808 05:03:12.395292 13144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:33679 every 8 connection(s)
I20260808 05:03:12.395596 13049 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:12.396202 13145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:12.398456 13145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038: Bootstrap starting.
I20260808 05:03:12.399109 13145 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:12.399398 13145 log.cc:824] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:12.400128 13145 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038: No bootstrap required, opened a new log
I20260808 05:03:12.402326 13145 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6730dadbfc974f4383bd7d51365a7038" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 33679 } }
I20260808 05:03:12.402546 13145 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:12.402590 13145 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6730dadbfc974f4383bd7d51365a7038, State: Initialized, Role: FOLLOWER
I20260808 05:03:12.402693 13145 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6730dadbfc974f4383bd7d51365a7038" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 33679 } }
I20260808 05:03:12.402750 13145 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:12.402769 13145 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:12.402803 13145 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:12.403285 13145 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6730dadbfc974f4383bd7d51365a7038" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 33679 } }
I20260808 05:03:12.403370 13145 leader_election.cc:302] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6730dadbfc974f4383bd7d51365a7038; no voters:
I20260808 05:03:12.403493 13145 leader_election.cc:288] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:12.403631 13153 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:12.403726 13145 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:12.403834 13153 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [term 1 LEADER]: Becoming Leader. State: Replica: 6730dadbfc974f4383bd7d51365a7038, State: Running, Role: LEADER
I20260808 05:03:12.403977 13153 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6730dadbfc974f4383bd7d51365a7038" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 33679 } }
I20260808 05:03:12.404377 13156 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6730dadbfc974f4383bd7d51365a7038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6730dadbfc974f4383bd7d51365a7038" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 33679 } } }
I20260808 05:03:12.404389 13159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6730dadbfc974f4383bd7d51365a7038. Latest consensus state: current_term: 1 leader_uuid: "6730dadbfc974f4383bd7d51365a7038" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6730dadbfc974f4383bd7d51365a7038" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 33679 } } }
I20260808 05:03:12.404486 13156 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:12.404520 13159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:12.404744 13167 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:12.405085 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 13049
I20260808 05:03:12.405191 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:12.405359 11547 external_mini_cluster.cc:1428] Setting key f550cb5ebcddff98708fe711d652994c
I20260808 05:03:12.405427 13167 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:12.407280 13167 catalog_manager.cc:1347] Generated new cluster ID: 445b44de043449d7bf70f8961c98ee21
I20260808 05:03:12.407336 13167 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:12.416167 13167 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:12.416712 13167 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:12.417341 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.405916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50970 (local address 127.11.70.254:33679)
0808 05:03:12.406162 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.406170 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.406201 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:03:12.406314 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.406321 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.406376 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.406538 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:12.407276 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.408679 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.409726 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.410343 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.410458 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.413375 (+ 2917us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:12.413379 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:12.413380 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:12.413392 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:12.415372 (+ 1980us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.415942 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.415944 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.415945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.416082 (+ 137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.416322 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.416323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.416324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.416624 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:12.416783 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.416919 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.417081 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":76,"threads_started":1}
I20260808 05:03:12.421507 13167 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038: Generated new TSK 0
I20260808 05:03:12.421684 13167 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:12.453709 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:33679
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:12.543184 13190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:12.543466 13190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:12.543525 13190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:12.544839 13190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:12.544919 13190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:12.544963 13190 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:03:12.545035 13190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:12.546773 13190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.70.254:33679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:12.547089 13190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:12.547392 13190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:12.553499 13201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:12.553573 13197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:12.553517 13199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:12.553697 13190 server_base.cc:1034] running on GCE node
I20260808 05:03:12.554018 13190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:12.554298 13190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:12.555495 13190 hybrid_clock.cc:648] HybridClock initialized: now 1786165392555489 us; error 46 us; skew 500 ppm
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:12.558228 13190 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:12.558723 13190 webserver.cc:460] Webserver started at http://127.11.70.193:42917/ using document root <none> and password file <none>
I20260808 05:03:12.558938 13190 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:12.558979 13190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:12.559069 13190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:12.560143 13190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "22afe6ff61a54e6185bced83e7fb8da5"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "3ebb73dc67abb20c648287c7361ecef0"
server_key_iv: "8886de0ac0e136015b7b6ca95add2285"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.560519 13190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "22afe6ff61a54e6185bced83e7fb8da5"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "3ebb73dc67abb20c648287c7361ecef0"
server_key_iv: "8886de0ac0e136015b7b6ca95add2285"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.562003 13190 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:12.562934 13209 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:12.563177 13190 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:12.563274 13190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "22afe6ff61a54e6185bced83e7fb8da5"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "3ebb73dc67abb20c648287c7361ecef0"
server_key_iv: "8886de0ac0e136015b7b6ca95add2285"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.563333 13190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:12.589941 13190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:12.592188 13190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:12.592307 13190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:12.592800 13190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:12.592839 13190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:12.592864 13190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:12.592929 13190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:12.600453 13190 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:34111
I20260808 05:03:12.600530 13374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:34111 every 8 connection(s)
I20260808 05:03:12.600847 13190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:12.604022 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.593490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:39627 (local address 127.11.70.254:33679)
0808 05:03:12.593542 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.593544 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.593803 (+ 259us) server_negotiation.cc:407] Connection header received
0808 05:03:12.594396 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.594397 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.594411 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.594501 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:12.595515 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.596340 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.598014 (+ 1674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.598312 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.598370 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.600939 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:12.600940 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:12.600941 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:12.600949 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:12.602458 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.602929 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.602930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.602931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.602998 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.603261 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.603262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.603262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.603402 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:12.603479 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.603835 (+ 356us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.603932 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:12.604193 13222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.593490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:33679 (local address 127.11.70.193:39627)
0808 05:03:12.593664 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:12.593708 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:12.594279 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:12.594616 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:12.594621 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:12.595051 (+ 430us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:12.595399 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.595406 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.596449 (+ 1043us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.596451 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.597917 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.597920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.598407 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.598408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.598599 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.599212 (+ 613us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:12.599221 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:12.600839 (+ 1618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:12.602605 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.602613 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.602615 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.602849 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.603068 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.603069 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.603069 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.603190 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.603480 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:12.603488 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:12.603625 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 05:03:12.603797 (+ 172us) client_negotiation.cc:240] Negotiation successful
0808 05:03:12.603959 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":87,"threads_started":1}
I20260808 05:03:12.604833 13377 heartbeater.cc:347] Connected to a master server at 127.11.70.254:33679
I20260808 05:03:12.604918 13377 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:12.605123 13377 heartbeater.cc:511] Master 127.11.70.254:33679 requested a full tablet report, sending...
I20260808 05:03:12.605809 13091 ts_manager.cc:194] Registered new tserver with Master: 22afe6ff61a54e6185bced83e7fb8da5 (127.11.70.193:34111)
I20260808 05:03:12.606734 13091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:39627
I20260808 05:03:12.609959 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 13190
I20260808 05:03:12.610091 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:12.610277 11547 external_mini_cluster.cc:1428] Setting key 149159f64d8198264ea8aded1c34e4da
I20260808 05:03:12.612078 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.606022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:59263 (local address 127.11.70.254:33679)
0808 05:03:12.606060 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.606061 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.606226 (+ 165us) server_negotiation.cc:407] Connection header received
0808 05:03:12.606250 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.606251 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.606261 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.606327 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:12.606674 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.607216 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.608197 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.608375 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.608430 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.609357 (+ 927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:12.609358 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:12.609359 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:12.609364 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:12.610963 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.611375 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.611376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.611376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.611430 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.611642 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.611643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.611643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.611742 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:12.611791 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.611963 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.612023 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:03:12.612227 13387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.605987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:33679 (local address 127.11.70.193:59263)
0808 05:03:12.606147 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:12.606158 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:12.606217 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:12.606329 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:12.606330 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:12.606530 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:12.606604 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.606606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.607328 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.607329 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.608117 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.608119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.608444 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.608445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.608502 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.608922 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:12.608928 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:12.609273 (+ 345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:12.611038 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.611039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.611040 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.611305 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.611501 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.611502 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.611503 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.611581 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.611805 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:12.611806 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:12.611865 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 05:03:12.611939 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:03:12.612056 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":106,"threads_started":1}
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:12.637681 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:33679
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:12.722695 13390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:12.722905 13390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:12.722930 13390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:12.724066 13390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:12.724100 13390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:12.724120 13390 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:03:12.724138 13390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:12.725564 13390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.70.254:33679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:12.725756 13390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:12.725934 13390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:12.731549 13399 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:12.731575 13390 server_base.cc:1034] running on GCE node
W20260808 05:03:12.731729 13404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:12.731585 13400 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:12.732020 13390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:12.732288 13390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:12.733441 13390 hybrid_clock.cc:648] HybridClock initialized: now 1786165392733434 us; error 31 us; skew 500 ppm
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:12.736119 13390 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:12.736620 13390 webserver.cc:460] Webserver started at http://127.11.70.194:32935/ using document root <none> and password file <none>
I20260808 05:03:12.736871 13390 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:12.736948 13390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:12.737102 13390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:12.738170 13390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "61d2874746284278aee2e2eb98b3b69b"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "6d6e623f3b684a2bfc888f0b93abbd64"
server_key_iv: "9ca900e5988c3547021ff4bdd189bb49"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.738667 13390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "61d2874746284278aee2e2eb98b3b69b"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "6d6e623f3b684a2bfc888f0b93abbd64"
server_key_iv: "9ca900e5988c3547021ff4bdd189bb49"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.740146 13390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:12.740912 13415 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:12.741102 13390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:12.741218 13390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "61d2874746284278aee2e2eb98b3b69b"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "6d6e623f3b684a2bfc888f0b93abbd64"
server_key_iv: "9ca900e5988c3547021ff4bdd189bb49"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.741299 13390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:12.760236 13390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:12.762210 13390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:12.762383 13390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:12.763011 13390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:12.763074 13390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:12.763118 13390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:12.763140 13390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:12.770934 13390 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:33663
I20260808 05:03:12.771029 13583 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:33663 every 8 connection(s)
I20260808 05:03:12.771404 13390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:12.773006 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.763469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:60347 (local address 127.11.70.254:33679)
0808 05:03:12.763547 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.763550 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.763741 (+ 191us) server_negotiation.cc:407] Connection header received
0808 05:03:12.764224 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.764225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.764259 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.764342 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:12.765033 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.765871 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.767264 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.767468 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.767560 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.770277 (+ 2717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:12.770279 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:12.770279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:12.770287 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:12.772005 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.772350 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.772351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.772351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.772400 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.772563 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.772563 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.772563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.772655 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:12.772701 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.772885 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.772943 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:03:12.773180 13427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.763448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:33679 (local address 127.11.70.194:60347)
0808 05:03:12.763603 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:12.763645 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:12.764129 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:12.764422 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:12.764425 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:12.764756 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:12.764950 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.764956 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.765967 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.765968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.767139 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.767142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.767573 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.767575 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.767729 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.768252 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:12.768264 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:12.770146 (+ 1882us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:12.772069 (+ 1923us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.772072 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.772074 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.772290 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.772437 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.772438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.772438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.772520 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.772691 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:12.772693 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:12.772796 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 05:03:12.772870 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:03:12.772981 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":84,"threads_started":1}
I20260808 05:03:12.773427 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 13390
I20260808 05:03:12.773502 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:12.773640 11547 external_mini_cluster.cc:1428] Setting key 4744481511426001d6a2a521b981974e
I20260808 05:03:12.774185 13584 heartbeater.cc:347] Connected to a master server at 127.11.70.254:33679
I20260808 05:03:12.774288 13584 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:12.774516 13584 heartbeater.cc:511] Master 127.11.70.254:33679 requested a full tablet report, sending...
I20260808 05:03:12.776479 13091 ts_manager.cc:194] Registered new tserver with Master: 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663)
I20260808 05:03:12.776991 13091 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:60347
I20260808 05:03:12.781421 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.775359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:49767 (local address 127.11.70.254:33679)
0808 05:03:12.775404 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.775405 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.775474 (+ 69us) server_negotiation.cc:407] Connection header received
0808 05:03:12.775543 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.775543 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.775551 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.775592 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:12.775983 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.776662 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.777528 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.777728 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.777808 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.778821 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:12.778822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:12.778823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:12.778829 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:12.780225 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.780581 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.780582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.780583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.780644 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.780860 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.780861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.780861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.781009 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:12.781087 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.781251 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.781330 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:03:12.781436 13592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.775265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:33679 (local address 127.11.70.194:49767)
0808 05:03:12.775413 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:12.775424 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:12.775486 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:12.775609 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:12.775610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:12.775828 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:12.775913 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.775915 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.776768 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.776769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.777432 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.777434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.777808 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.777809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.777878 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.778351 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:12.778356 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:12.778715 (+ 359us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:12.780329 (+ 1614us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.780330 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.780330 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.780506 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.780714 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.780715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.780716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.780777 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.781092 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:12.781093 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:12.781138 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:03:12.781224 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 05:03:12.781331 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:12.801723 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:33679
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:12.887449 13597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:12.887698 13597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:12.887742 13597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:12.888912 13597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:12.888983 13597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:12.889041 13597 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:03:12.889101 13597 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:12.890600 13597 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.70.254:33679
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:12.890856 13597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:12.891108 13597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:12.896421 13606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:12.896428 13603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:12.896451 13604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:12.896801 13597 server_base.cc:1034] running on GCE node
I20260808 05:03:12.896991 13597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:12.897194 13597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:12.898334 13597 hybrid_clock.cc:648] HybridClock initialized: now 1786165392898321 us; error 28 us; skew 500 ppm
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:12.900854 13597 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:12.901336 13597 webserver.cc:460] Webserver started at http://127.11.70.195:39015/ using document root <none> and password file <none>
I20260808 05:03:12.901518 13597 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:12.901559 13597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:12.901649 13597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:12.902702 13597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "bd313dd26f2d456ab3b9a5f70f3912e4"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "3bb563b69c56465e44a1c2dcbfc0a63f"
server_key_iv: "dc6feeb836b662895b09801d5e2e8fe9"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.903081 13597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "bd313dd26f2d456ab3b9a5f70f3912e4"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "3bb563b69c56465e44a1c2dcbfc0a63f"
server_key_iv: "dc6feeb836b662895b09801d5e2e8fe9"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.904536 13597 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:12.905496 13614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:12.905692 13597 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:12.905817 13597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "bd313dd26f2d456ab3b9a5f70f3912e4"
format_stamp: "Formatted at 2026-08-08 05:03:12 on dist-test-slave-7kzw"
server_key: "3bb563b69c56465e44a1c2dcbfc0a63f"
server_key_iv: "dc6feeb836b662895b09801d5e2e8fe9"
server_key_version: "encryptionkey@0"
I20260808 05:03:12.905900 13597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:12.921073 13597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:12.923512 13597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:12.923684 13597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:12.924211 13597 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:12.924278 13597 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:12.924326 13597 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:12.924351 13597 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:12.931581 13597 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:43401
I20260808 05:03:12.931720 13775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:43401 every 8 connection(s)
I20260808 05:03:12.931975 13597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:03:12.935113 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.924718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:58623 (local address 127.11.70.254:33679)
0808 05:03:12.924763 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.924765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.925011 (+ 246us) server_negotiation.cc:407] Connection header received
0808 05:03:12.925544 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.925545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.925559 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.925607 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:12.926448 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.927272 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.928966 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.929292 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.929372 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.932107 (+ 2735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:12.932108 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:12.932109 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:12.932117 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:12.933625 (+ 1508us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.934052 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.934053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.934053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.934135 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.934408 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.934408 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.934409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.934572 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:12.934645 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.934927 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.935010 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:03:12.935292 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.924717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:33679 (local address 127.11.70.195:58623)
0808 05:03:12.924873 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:12.924908 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:12.925433 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:12.925716 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:12.925721 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:12.926066 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:12.926345 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.926353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.927383 (+ 1030us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.927385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.928859 (+ 1474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.928863 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.929401 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.929403 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.929555 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.930079 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:12.930091 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:12.931988 (+ 1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:12.933734 (+ 1746us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.933741 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.933743 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.933971 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.934213 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.934214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.934214 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.934329 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.934648 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:12.934655 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:12.934791 (+ 136us) client_negotiation.cc:769] Sending connection context
0808 05:03:12.934903 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 05:03:12.935058 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260808 05:03:12.935773 13776 heartbeater.cc:347] Connected to a master server at 127.11.70.254:33679
I20260808 05:03:12.935861 13776 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:12.936043 13776 heartbeater.cc:511] Master 127.11.70.254:33679 requested a full tablet report, sending...
I20260808 05:03:12.936432 13090 ts_manager.cc:194] Registered new tserver with Master: bd313dd26f2d456ab3b9a5f70f3912e4 (127.11.70.195:43401)
I20260808 05:03:12.936990 13090 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:58623
I20260808 05:03:12.937393 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 13597
I20260808 05:03:12.937484 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:12.937624 11547 external_mini_cluster.cc:1428] Setting key 119f499cb67c6c746e8be8f695ea8c15
I20260808 05:03:12.938508 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:03:12.943003 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.936929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:50467 (local address 127.11.70.254:33679)
0808 05:03:12.936969 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.936971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.937048 (+ 77us) server_negotiation.cc:407] Connection header received
0808 05:03:12.937340 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.937341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.937355 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.937421 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:12.937801 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.938411 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.939174 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.939450 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.939528 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.940449 (+ 921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:12.940451 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:12.940451 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:12.940458 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:12.941812 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.942149 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.942151 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.942151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.942210 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.942427 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.942428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.942428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.942582 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:12.942661 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.942839 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.942909 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:03:12.943015 13785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.936830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:33679 (local address 127.11.70.195:50467)
0808 05:03:12.936984 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:12.936995 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:12.937060 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:12.937440 (+ 380us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:12.937441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:12.937634 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:12.937701 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.937703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.938540 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.938541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.939091 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.939093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.939533 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.939534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.939592 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.940039 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:12.940044 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:12.940361 (+ 317us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:12.941882 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.941883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.941883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.942041 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.942297 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:12.942297 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:12.942298 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:12.942360 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:12.942654 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:12.942655 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:12.942723 (+ 68us) client_negotiation.cc:769] Sending connection context
0808 05:03:12.942798 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:03:12.942909 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":95,"threads_started":1}
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:03:12 dist-test-slave-7kzw krb5kdc[13032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:12.963653 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.956821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50980 (local address 127.11.70.254:33679)
0808 05:03:12.956890 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.956895 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.956904 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:12.956927 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.956927 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.956937 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.956988 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:12.957528 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.957994 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.958784 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.958959 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.959011 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.961254 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:12.961255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:12.961255 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:12.961261 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:12.962715 (+ 1454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.963053 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.963053 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.963054 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.963105 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:12.963273 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:12.963273 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:12.963273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:12.963369 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:12.963444 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.963533 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.963590 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:03:12.965232 13090 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:12.967134 13090 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:12.974113 13796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.969609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:33663 (local address 127.0.0.1:57784)
0808 05:03:12.969797 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:12.969856 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:12.969925 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:12.970216 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:12.970219 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:12.970221 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:12.970290 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.970292 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.971605 (+ 1313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.971606 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.972914 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.972915 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.973766 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.973767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.973843 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.973854 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 05:03:12.973969 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 05:03:12.974029 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":33,"thread_start_us":63,"threads_started":1}
I20260808 05:03:12.974182 13799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.969809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57784 (local address 127.11.70.194:33663)
0808 05:03:12.970003 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.970007 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.970020 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:03:12.970064 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.970066 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.970083 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.970178 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:12.970364 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.971531 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.973014 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.973667 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.973743 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.973800 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.973993 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.974034 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":116,"threads_started":1}
I20260808 05:03:12.974555 13798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.969658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:34111 (local address 127.0.0.1:51724)
0808 05:03:12.970399 (+ 741us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:12.970408 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:12.970452 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:12.970735 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:12.970736 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:12.970738 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:12.970769 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.970770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.971892 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.971893 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.972803 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.972805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.974310 (+ 1505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.974311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.974372 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.974376 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:12.974434 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:03:12.974497 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":76,"threads_started":1}
I20260808 05:03:12.974967 13797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.969617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:43401 (local address 127.0.0.1:52608)
0808 05:03:12.970256 (+ 639us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:12.970267 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:12.970318 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:12.970602 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:12.970603 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:12.970604 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:12.970662 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.970664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.971546 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.971547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.972899 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:12.972902 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.974789 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.974790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:12.974850 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.974853 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:12.974896 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 05:03:12.974924 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"mutex_wait_us":51,"thread_start_us":106,"threads_started":1}
I20260808 05:03:12.975064 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.969885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52608 (local address 127.11.70.195:43401)
0808 05:03:12.970300 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.970305 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.970315 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:12.970383 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.970385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.970400 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.970514 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:12.970742 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.971454 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.973841 (+ 2387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.974705 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.974787 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.974840 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.974924 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.974962 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":105,"threads_started":1}
I20260808 05:03:12.974985 13485 tablet_service.cc:1467] Processing CreateTablet for tablet cf03abd1be914c7595d76da5e3e9a3df (DEFAULT_TABLE table=test-table [id=52b3e6dd46804069968e49dabddc4942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:12.975404 13485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf03abd1be914c7595d76da5e3e9a3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:12.978294 13803 tablet_bootstrap.cc:492] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: Bootstrap starting.
I20260808 05:03:12.978914 13686 tablet_service.cc:1467] Processing CreateTablet for tablet cf03abd1be914c7595d76da5e3e9a3df (DEFAULT_TABLE table=test-table [id=52b3e6dd46804069968e49dabddc4942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:12.979017 13803 tablet_bootstrap.cc:654] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:12.979233 13686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf03abd1be914c7595d76da5e3e9a3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:12.979388 13803 log.cc:824] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:12.980134 13803 tablet_bootstrap.cc:492] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: No bootstrap required, opened a new log
I20260808 05:03:12.980198 13803 ts_tablet_manager.cc:1397] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:12.981825 13803 raft_consensus.cc:348] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:12.981978 13803 raft_consensus.cc:374] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:12.982023 13803 raft_consensus.cc:729] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61d2874746284278aee2e2eb98b3b69b, State: Initialized, Role: FOLLOWER
I20260808 05:03:12.982053 13808 tablet_bootstrap.cc:492] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: Bootstrap starting.
I20260808 05:03:12.982167 13803 consensus_queue.cc:260] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:12.982430 13801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:12.970054 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51724 (local address 127.11.70.193:34111)
0808 05:03:12.970257 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:12.970261 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:12.970533 (+ 272us) server_negotiation.cc:407] Connection header received
0808 05:03:12.970578 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:12.970581 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:12.970596 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:12.970668 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:12.970849 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.971811 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.972887 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:12.973663 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:12.973743 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:12.973801 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:12.982245 (+ 8444us) server_negotiation.cc:299] Negotiation successful
0808 05:03:12.982302 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":103,"threads_started":1}
I20260808 05:03:12.982514 13584 heartbeater.cc:503] Master 127.11.70.254:33679 was elected leader, sending a full tablet report...
I20260808 05:03:12.982970 13803 ts_tablet_manager.cc:1428] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:03:12.983101 13808 tablet_bootstrap.cc:654] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:12.983295 13277 tablet_service.cc:1467] Processing CreateTablet for tablet cf03abd1be914c7595d76da5e3e9a3df (DEFAULT_TABLE table=test-table [id=52b3e6dd46804069968e49dabddc4942]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:12.983461 13808 log.cc:824] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:12.983664 13277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cf03abd1be914c7595d76da5e3e9a3df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:12.984177 13808 tablet_bootstrap.cc:492] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: No bootstrap required, opened a new log
I20260808 05:03:12.984221 13808 ts_tablet_manager.cc:1397] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:12.985785 13808 raft_consensus.cc:348] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:12.985895 13808 raft_consensus.cc:374] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:12.985915 13808 raft_consensus.cc:729] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd313dd26f2d456ab3b9a5f70f3912e4, State: Initialized, Role: FOLLOWER
I20260808 05:03:12.986024 13808 consensus_queue.cc:260] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:12.986289 13808 ts_tablet_manager.cc:1428] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:12.986356 13776 heartbeater.cc:503] Master 127.11.70.254:33679 was elected leader, sending a full tablet report...
I20260808 05:03:12.986680 13813 tablet_bootstrap.cc:492] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: Bootstrap starting.
I20260808 05:03:12.987354 13813 tablet_bootstrap.cc:654] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:12.987684 13813 log.cc:824] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:12.988348 13813 tablet_bootstrap.cc:492] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: No bootstrap required, opened a new log
I20260808 05:03:12.988432 13813 ts_tablet_manager.cc:1397] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:12.990039 13813 raft_consensus.cc:348] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:12.990188 13813 raft_consensus.cc:374] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:12.990236 13813 raft_consensus.cc:729] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22afe6ff61a54e6185bced83e7fb8da5, State: Initialized, Role: FOLLOWER
I20260808 05:03:12.990348 13813 consensus_queue.cc:260] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:12.990625 13813 ts_tablet_manager.cc:1428] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:12.990721 13377 heartbeater.cc:503] Master 127.11.70.254:33679 was elected leader, sending a full tablet report...
W20260808 05:03:13.022116 13585 tablet.cc:2369] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:13.041592 13812 raft_consensus.cc:482] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:13.041776 13812 raft_consensus.cc:504] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.042173 13812 leader_election.cc:288] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663), 22afe6ff61a54e6185bced83e7fb8da5 (127.11.70.193:34111)
I20260808 05:03:13.045567 13801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.042516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:40347 (local address 127.11.70.193:34111)
0808 05:03:13.042567 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.042570 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.042626 (+ 56us) server_negotiation.cc:407] Connection header received
0808 05:03:13.042659 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.042660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.042672 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.042731 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:13.043114 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.043663 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.044776 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.045169 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.045261 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.045270 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.045441 (+ 171us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.045483 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:03:13.045580 13799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.042516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:58785 (local address 127.11.70.194:33663)
0808 05:03:13.042567 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.042570 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.042751 (+ 181us) server_negotiation.cc:407] Connection header received
0808 05:03:13.042787 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.042788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.042797 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.042856 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:13.043106 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.043708 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.044767 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.045163 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.045256 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.045264 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.045457 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.045503 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:03:13.045603 13628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.042415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:34111 (local address 127.11.70.195:40347)
0808 05:03:13.042501 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:13.042514 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:13.042564 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:13.042908 (+ 344us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:13.042909 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:13.042910 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:13.043000 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.043001 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.043762 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.043763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.044685 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.044688 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.045259 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.045260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.045364 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.045367 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:13.045435 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 05:03:13.045499 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65,"mutex_wait_us":69}
I20260808 05:03:13.045933 13817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.042418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:33663 (local address 127.11.70.195:58785)
0808 05:03:13.042653 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:13.042664 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:13.042730 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:13.042896 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:13.042900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:13.042902 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:13.042988 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.042990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.043798 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.043799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.044654 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.044656 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.045255 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.045256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.045372 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.045376 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:13.045438 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:03:13.045501 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":47,"thread_start_us":146,"threads_started":1}
I20260808 05:03:13.045985 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf03abd1be914c7595d76da5e3e9a3df" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22afe6ff61a54e6185bced83e7fb8da5" is_pre_election: true
I20260808 05:03:13.046170 13306 raft_consensus.cc:2454] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 0.
I20260808 05:03:13.046275 13512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf03abd1be914c7595d76da5e3e9a3df" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61d2874746284278aee2e2eb98b3b69b" is_pre_election: true
I20260808 05:03:13.046445 13512 raft_consensus.cc:2454] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 0.
I20260808 05:03:13.046541 13615 leader_election.cc:302] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 22afe6ff61a54e6185bced83e7fb8da5, bd313dd26f2d456ab3b9a5f70f3912e4; no voters:
I20260808 05:03:13.046759 13812 raft_consensus.cc:2781] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:13.046815 13812 raft_consensus.cc:482] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:13.046833 13812 raft_consensus.cc:3037] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:13.047592 13812 raft_consensus.cc:504] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.047741 13812 leader_election.cc:288] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 election: Requested vote from peers 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663), 22afe6ff61a54e6185bced83e7fb8da5 (127.11.70.193:34111)
I20260808 05:03:13.047894 13512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf03abd1be914c7595d76da5e3e9a3df" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61d2874746284278aee2e2eb98b3b69b"
I20260808 05:03:13.047899 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cf03abd1be914c7595d76da5e3e9a3df" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22afe6ff61a54e6185bced83e7fb8da5"
I20260808 05:03:13.047961 13512 raft_consensus.cc:3037] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:13.048002 13306 raft_consensus.cc:3037] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:13.048765 13512 raft_consensus.cc:2454] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 1.
I20260808 05:03:13.048779 13306 raft_consensus.cc:2454] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 1.
I20260808 05:03:13.048956 13619 leader_election.cc:302] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61d2874746284278aee2e2eb98b3b69b, bd313dd26f2d456ab3b9a5f70f3912e4; no voters:
I20260808 05:03:13.049108 13812 raft_consensus.cc:2781] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:13.049294 13812 raft_consensus.cc:686] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 LEADER]: Becoming Leader. State: Replica: bd313dd26f2d456ab3b9a5f70f3912e4, State: Running, Role: LEADER
I20260808 05:03:13.049407 13812 consensus_queue.cc:237] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.050369 13090 catalog_manager.cc:5495] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd313dd26f2d456ab3b9a5f70f3912e4 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } health_report { overall_health: HEALTHY } } }
I20260808 05:03:13.071496 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.068641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52620 (local address 127.11.70.195:43401)
0808 05:03:13.068709 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.068711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.068723 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:03:13.068861 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.068862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.068878 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.068948 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:13.069107 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.069574 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.070368 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.070614 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.070686 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.070905 (+ 219us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:13.071006 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:13.071105 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.071148 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.071170 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:03:13.073381 13512 raft_consensus.cc:1261] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Refusing update from remote peer bd313dd26f2d456ab3b9a5f70f3912e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:13.073386 13306 raft_consensus.cc:1261] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Refusing update from remote peer bd313dd26f2d456ab3b9a5f70f3912e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:13.073827 13812 consensus_queue.cc:1035] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:13.073966 13819 consensus_queue.cc:1035] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:13.076625 13823 mvcc.cc:205] Tried to move back new op lower bound from 7316133450025697280 to 7316133449931448320. Current Snapshot: MvccSnapshot[applied={T|T < 7316133450025697280}]
I20260808 05:03:13.076896 13824 mvcc.cc:205] Tried to move back new op lower bound from 7316133450025697280 to 7316133449931448320. Current Snapshot: MvccSnapshot[applied={T|T < 7316133450025697280}]
I20260808 05:03:13.077318 13825 mvcc.cc:205] Tried to move back new op lower bound from 7316133450025697280 to 7316133449931448320. Current Snapshot: MvccSnapshot[applied={T|T < 7316133450025697280}]
I20260808 05:03:13.081363 13091 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:13.081480 13091 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:13.082404 13091 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038: Sending DeleteTablet for 3 replicas of tablet cf03abd1be914c7595d76da5e3e9a3df
I20260808 05:03:13.082932 13485 tablet_service.cc:1514] Processing DeleteTablet for tablet cf03abd1be914c7595d76da5e3e9a3df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:13 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:57784
I20260808 05:03:13.082989 13686 tablet_service.cc:1514] Processing DeleteTablet for tablet cf03abd1be914c7595d76da5e3e9a3df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:13 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:52608
I20260808 05:03:13.083248 13845 tablet_replica.cc:330] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: stopping tablet replica
I20260808 05:03:13.083351 13845 raft_consensus.cc:2229] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:13.083473 13845 raft_consensus.cc:2258] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:13.083876 13843 tablet_replica.cc:330] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: stopping tablet replica
I20260808 05:03:13.083977 13843 raft_consensus.cc:2229] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:13.084084 13843 raft_consensus.cc:2258] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:13.084273 13091 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50980:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:13.084437 13091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:13.085098 13277 tablet_service.cc:1514] Processing DeleteTablet for tablet cf03abd1be914c7595d76da5e3e9a3df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:13 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:51724
I20260808 05:03:13.085335 13845 ts_tablet_manager.cc:1905] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:13.085760 13485 tablet_service.cc:1467] Processing CreateTablet for tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce (DEFAULT_TABLE table=test-table [id=c02e25e3fcca474b92e96f9653452fd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:13.085880 13485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:13.085899 13686 tablet_service.cc:1467] Processing CreateTablet for tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce (DEFAULT_TABLE table=test-table [id=c02e25e3fcca474b92e96f9653452fd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:13.086006 13686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:13.087200 13845 ts_tablet_manager.cc:1918] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:13.087284 13845 log.cc:1196] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/cf03abd1be914c7595d76da5e3e9a3df
I20260808 05:03:13.087391 13808 tablet_bootstrap.cc:492] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: Bootstrap starting.
I20260808 05:03:13.087507 13803 tablet_bootstrap.cc:492] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: Bootstrap starting.
I20260808 05:03:13.087595 13845 ts_tablet_manager.cc:1939] T cf03abd1be914c7595d76da5e3e9a3df P bd313dd26f2d456ab3b9a5f70f3912e4: Deleting consensus metadata
I20260808 05:03:13.087875 13808 tablet_bootstrap.cc:654] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:13.087954 13803 tablet_bootstrap.cc:654] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:13.087996 13077 catalog_manager.cc:4841] TS bd313dd26f2d456ab3b9a5f70f3912e4 (127.11.70.195:43401): tablet cf03abd1be914c7595d76da5e3e9a3df (table test-table [id=52b3e6dd46804069968e49dabddc4942]) successfully deleted
I20260808 05:03:13.088510 13277 tablet_service.cc:1467] Processing CreateTablet for tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce (DEFAULT_TABLE table=test-table [id=c02e25e3fcca474b92e96f9653452fd9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:13.088572 13808 tablet_bootstrap.cc:492] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: No bootstrap required, opened a new log
I20260808 05:03:13.088634 13808 ts_tablet_manager.cc:1397] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:13.088658 13277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:13.088799 13808 raft_consensus.cc:348] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.088901 13808 raft_consensus.cc:374] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:13.088932 13808 raft_consensus.cc:729] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd313dd26f2d456ab3b9a5f70f3912e4, State: Initialized, Role: FOLLOWER
I20260808 05:03:13.088976 13808 consensus_queue.cc:260] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.089068 13808 ts_tablet_manager.cc:1428] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:13.090161 13813 tablet_bootstrap.cc:492] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: Bootstrap starting.
I20260808 05:03:13.090405 13843 ts_tablet_manager.cc:1905] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:13.090862 13813 tablet_bootstrap.cc:654] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:13.091524 13813 tablet_bootstrap.cc:492] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: No bootstrap required, opened a new log
I20260808 05:03:13.091580 13813 ts_tablet_manager.cc:1397] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:13.091845 13813 raft_consensus.cc:348] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.091939 13813 raft_consensus.cc:374] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:13.091933 13843 ts_tablet_manager.cc:1918] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:13.091971 13813 raft_consensus.cc:729] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22afe6ff61a54e6185bced83e7fb8da5, State: Initialized, Role: FOLLOWER
I20260808 05:03:13.091997 13843 log.cc:1196] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/cf03abd1be914c7595d76da5e3e9a3df
I20260808 05:03:13.092017 13813 consensus_queue.cc:260] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.092116 13813 ts_tablet_manager.cc:1428] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:13.092267 13843 ts_tablet_manager.cc:1939] T cf03abd1be914c7595d76da5e3e9a3df P 61d2874746284278aee2e2eb98b3b69b: Deleting consensus metadata
I20260808 05:03:13.092643 13076 catalog_manager.cc:4841] TS 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663): tablet cf03abd1be914c7595d76da5e3e9a3df (table test-table [id=52b3e6dd46804069968e49dabddc4942]) successfully deleted
I20260808 05:03:13.092983 13803 tablet_bootstrap.cc:492] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: No bootstrap required, opened a new log
I20260808 05:03:13.093052 13803 ts_tablet_manager.cc:1397] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 05:03:13.093212 13803 raft_consensus.cc:348] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.093287 13803 raft_consensus.cc:374] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:13.093321 13803 raft_consensus.cc:729] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61d2874746284278aee2e2eb98b3b69b, State: Initialized, Role: FOLLOWER
I20260808 05:03:13.093374 13803 consensus_queue.cc:260] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.093459 13803 ts_tablet_manager.cc:1428] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:13.094610 13846 tablet_replica.cc:330] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: stopping tablet replica
I20260808 05:03:13.094743 13846 raft_consensus.cc:2229] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:13.094887 13846 raft_consensus.cc:2258] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:13.095294 13846 ts_tablet_manager.cc:1905] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:13.096518 13846 ts_tablet_manager.cc:1918] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:13.096580 13846 log.cc:1196] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/cf03abd1be914c7595d76da5e3e9a3df
I20260808 05:03:13.096868 13846 ts_tablet_manager.cc:1939] T cf03abd1be914c7595d76da5e3e9a3df P 22afe6ff61a54e6185bced83e7fb8da5: Deleting consensus metadata
I20260808 05:03:13.097237 13073 catalog_manager.cc:4841] TS 22afe6ff61a54e6185bced83e7fb8da5 (127.11.70.193:34111): tablet cf03abd1be914c7595d76da5e3e9a3df (table test-table [id=52b3e6dd46804069968e49dabddc4942]) successfully deleted
W20260808 05:03:13.101832 13378 tablet.cc:2369] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:13.167451 13819 raft_consensus.cc:482] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:13.167598 13816 raft_consensus.cc:482] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:13.167570 13819 raft_consensus.cc:504] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.167740 13819 leader_election.cc:288] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 22afe6ff61a54e6185bced83e7fb8da5 (127.11.70.193:34111), 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663)
I20260808 05:03:13.167706 13816 raft_consensus.cc:504] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.167945 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63ac0caf2e7b409eaf0dc72c7ca5cfce" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22afe6ff61a54e6185bced83e7fb8da5" is_pre_election: true
I20260808 05:03:13.168015 13306 raft_consensus.cc:2454] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 0.
I20260808 05:03:13.167959 13512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63ac0caf2e7b409eaf0dc72c7ca5cfce" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61d2874746284278aee2e2eb98b3b69b" is_pre_election: true
I20260808 05:03:13.168081 13512 raft_consensus.cc:2454] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 0.
I20260808 05:03:13.168242 13619 leader_election.cc:302] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61d2874746284278aee2e2eb98b3b69b, bd313dd26f2d456ab3b9a5f70f3912e4; no voters:
I20260808 05:03:13.168329 13819 raft_consensus.cc:2781] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:13.168357 13819 raft_consensus.cc:482] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:13.168023 13816 leader_election.cc:288] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663), bd313dd26f2d456ab3b9a5f70f3912e4 (127.11.70.195:43401)
I20260808 05:03:13.168378 13819 raft_consensus.cc:3037] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:13.169335 13819 raft_consensus.cc:504] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.169462 13819 leader_election.cc:288] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 election: Requested vote from peers 22afe6ff61a54e6185bced83e7fb8da5 (127.11.70.193:34111), 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663)
I20260808 05:03:13.169672 13512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63ac0caf2e7b409eaf0dc72c7ca5cfce" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61d2874746284278aee2e2eb98b3b69b"
I20260808 05:03:13.169740 13512 raft_consensus.cc:3037] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:13.169934 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63ac0caf2e7b409eaf0dc72c7ca5cfce" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22afe6ff61a54e6185bced83e7fb8da5"
I20260808 05:03:13.169998 13306 raft_consensus.cc:3037] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:13.170585 13512 raft_consensus.cc:2454] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 1.
I20260808 05:03:13.170768 13306 raft_consensus.cc:2454] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 1.
I20260808 05:03:13.170779 13619 leader_election.cc:302] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61d2874746284278aee2e2eb98b3b69b, bd313dd26f2d456ab3b9a5f70f3912e4; no voters:
I20260808 05:03:13.170862 13819 raft_consensus.cc:2781] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:13.170897 13819 raft_consensus.cc:686] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 LEADER]: Becoming Leader. State: Replica: bd313dd26f2d456ab3b9a5f70f3912e4, State: Running, Role: LEADER
I20260808 05:03:13.170940 13819 consensus_queue.cc:237] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } }
I20260808 05:03:13.171555 13091 catalog_manager.cc:5495] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd313dd26f2d456ab3b9a5f70f3912e4 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } health_report { overall_health: HEALTHY } } }
I20260808 05:03:13.172021 13799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.168396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:39405 (local address 127.11.70.194:33663)
0808 05:03:13.168439 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.168442 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.168623 (+ 181us) server_negotiation.cc:407] Connection header received
0808 05:03:13.168738 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.168739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.168750 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.168780 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:13.168980 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.169673 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.171126 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.171612 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.171673 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.171683 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.171916 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.171955 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:03:13.172399 13852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.168195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:33663 (local address 127.11.70.193:39405)
0808 05:03:13.168573 (+ 378us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:13.168582 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:13.168647 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:13.168849 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:13.168850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:13.168852 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:13.168905 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.168906 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.169757 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.169757 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.171022 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.171025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.171762 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.171763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.171832 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.171837 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:03:13.172274 (+ 437us) client_negotiation.cc:240] Negotiation successful
0808 05:03:13.172321 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":368,"thread_start_us":66,"threads_started":1}
I20260808 05:03:13.172819 13512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63ac0caf2e7b409eaf0dc72c7ca5cfce" candidate_uuid: "22afe6ff61a54e6185bced83e7fb8da5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61d2874746284278aee2e2eb98b3b69b" is_pre_election: true
I20260808 05:03:13.172943 13512 raft_consensus.cc:2379] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 22afe6ff61a54e6185bced83e7fb8da5 in current term 1: Already voted for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in this term.
I20260808 05:03:13.173854 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.168481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:47561 (local address 127.11.70.195:43401)
0808 05:03:13.168563 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.168565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.168572 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:13.168596 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.168597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.168607 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.168655 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:13.168868 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.169627 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.172859 (+ 3232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.173453 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.173534 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.173543 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.173737 (+ 194us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.173779 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260808 05:03:13.173856 13854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.168194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:43401 (local address 127.11.70.193:47561)
0808 05:03:13.168436 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:13.168447 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:13.168501 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:13.168706 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:13.168707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:13.168711 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:13.168786 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.168788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.169732 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.169733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.172753 (+ 3020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.172756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.173551 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.173552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.173631 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.173635 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:13.173725 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:03:13.173768 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":227,"mutex_wait_us":1353,"thread_start_us":68,"threads_started":1}
I20260808 05:03:13.174167 13713 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63ac0caf2e7b409eaf0dc72c7ca5cfce" candidate_uuid: "22afe6ff61a54e6185bced83e7fb8da5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" is_pre_election: true
I20260808 05:03:13.174539 13217 leader_election.cc:302] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 22afe6ff61a54e6185bced83e7fb8da5; no voters: 61d2874746284278aee2e2eb98b3b69b, bd313dd26f2d456ab3b9a5f70f3912e4
I20260808 05:03:13.174698 13816 raft_consensus.cc:2726] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260808 05:03:13.182811 13777 tablet.cc:2369] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 05:03:13 dist-test-slave-7kzw krb5kdc[13032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:13.223098 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.215396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50988 (local address 127.11.70.254:33679)
0808 05:03:13.215481 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.215484 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.215666 (+ 182us) server_negotiation.cc:407] Connection header received
0808 05:03:13.215702 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.215703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.215725 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.215791 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:13.216278 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.216838 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.217542 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.217743 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.217813 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.220523 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:13.220524 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:13.220525 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:13.220531 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:13.221963 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:13.222342 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:13.222343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:13.222343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:13.222394 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:13.222667 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:13.222668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:13.222669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:13.222778 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:13.222834 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.222959 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.223030 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:03:13.223258 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.215336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:33679 (local address 127.0.0.1:50988)
0808 05:03:13.215575 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:13.215586 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:13.215654 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:13.215809 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:13.215810 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:13.216118 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:13.216187 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.216189 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.216923 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.216924 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.217453 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.217454 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.217818 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.217818 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.217861 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.218399 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:13.218403 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:13.220423 (+ 2020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:13.222043 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:13.222063 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:13.222065 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:13.222272 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:13.222454 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:13.222454 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:13.222455 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:13.222590 (+ 135us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:13.222841 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:13.222848 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:13.222891 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 05:03:13.222943 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:03:13.223146 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":88,"thread_start_us":149,"threads_started":1}
I20260808 05:03:13.225629 13091 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:50988:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 05:03:13.225907 13091 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:13.227509 13485 tablet_service.cc:1467] Processing CreateTablet for tablet b0e6fd9815024bcebc9e9f3f19facb75 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=90367b79c14b4053bb2a42a7d84bd238]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:03:13.227583 13277 tablet_service.cc:1467] Processing CreateTablet for tablet b0e6fd9815024bcebc9e9f3f19facb75 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=90367b79c14b4053bb2a42a7d84bd238]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:03:13.227524 13686 tablet_service.cc:1467] Processing CreateTablet for tablet b0e6fd9815024bcebc9e9f3f19facb75 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=90367b79c14b4053bb2a42a7d84bd238]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:03:13.227744 13277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0e6fd9815024bcebc9e9f3f19facb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:13.227751 13485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0e6fd9815024bcebc9e9f3f19facb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:13.227744 13686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b0e6fd9815024bcebc9e9f3f19facb75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:13.229102 13803 tablet_bootstrap.cc:492] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: Bootstrap starting.
I20260808 05:03:13.229408 13808 tablet_bootstrap.cc:492] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: Bootstrap starting.
I20260808 05:03:13.229596 13803 tablet_bootstrap.cc:654] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:13.229732 13808 tablet_bootstrap.cc:654] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:13.230077 13813 tablet_bootstrap.cc:492] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: Bootstrap starting.
I20260808 05:03:13.230515 13808 tablet_bootstrap.cc:492] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: No bootstrap required, opened a new log
I20260808 05:03:13.230553 13813 tablet_bootstrap.cc:654] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:13.230566 13808 ts_tablet_manager.cc:1397] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:13.230690 13808 raft_consensus.cc:348] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } }
I20260808 05:03:13.230788 13808 raft_consensus.cc:374] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:13.230813 13808 raft_consensus.cc:729] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd313dd26f2d456ab3b9a5f70f3912e4, State: Initialized, Role: FOLLOWER
I20260808 05:03:13.230858 13808 consensus_queue.cc:260] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } }
I20260808 05:03:13.230970 13808 ts_tablet_manager.cc:1428] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:13.231074 13812 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.231158 13812 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:13.231312 13813 tablet_bootstrap.cc:492] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: No bootstrap required, opened a new log
I20260808 05:03:13.231357 13813 ts_tablet_manager.cc:1397] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:13.231462 13803 tablet_bootstrap.cc:492] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: No bootstrap required, opened a new log
I20260808 05:03:13.231504 13803 ts_tablet_manager.cc:1397] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:13.231504 13813 raft_consensus.cc:348] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } }
I20260808 05:03:13.231567 13813 raft_consensus.cc:374] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:13.231587 13813 raft_consensus.cc:729] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22afe6ff61a54e6185bced83e7fb8da5, State: Initialized, Role: FOLLOWER
I20260808 05:03:13.231678 13813 consensus_queue.cc:260] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } }
I20260808 05:03:13.231678 13803 raft_consensus.cc:348] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } }
I20260808 05:03:13.231750 13803 raft_consensus.cc:374] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:13.231772 13803 raft_consensus.cc:729] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61d2874746284278aee2e2eb98b3b69b, State: Initialized, Role: FOLLOWER
I20260808 05:03:13.231789 13813 ts_tablet_manager.cc:1428] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:13.231818 13803 consensus_queue.cc:260] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } }
I20260808 05:03:13.231846 13816 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.231904 13803 ts_tablet_manager.cc:1428] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:13.231943 13816 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:13.232071 13809 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.232164 13809 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:13.463796 13812 raft_consensus.cc:482] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:13.463904 13812 raft_consensus.cc:504] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } }
I20260808 05:03:13.464063 13812 leader_election.cc:288] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663), 22afe6ff61a54e6185bced83e7fb8da5 (127.11.70.193:34111)
I20260808 05:03:13.464311 13512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0e6fd9815024bcebc9e9f3f19facb75" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61d2874746284278aee2e2eb98b3b69b" is_pre_election: true
I20260808 05:03:13.464335 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0e6fd9815024bcebc9e9f3f19facb75" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22afe6ff61a54e6185bced83e7fb8da5" is_pre_election: true
I20260808 05:03:13.464429 13306 raft_consensus.cc:2454] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 0.
I20260808 05:03:13.464433 13512 raft_consensus.cc:2454] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 0.
I20260808 05:03:13.464613 13619 leader_election.cc:302] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61d2874746284278aee2e2eb98b3b69b, bd313dd26f2d456ab3b9a5f70f3912e4; no voters:
I20260808 05:03:13.464746 13812 raft_consensus.cc:2781] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:13.464804 13812 raft_consensus.cc:482] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:13.464838 13812 raft_consensus.cc:3037] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:13.465595 13812 raft_consensus.cc:504] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } }
I20260808 05:03:13.465751 13812 leader_election.cc:288] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 election: Requested vote from peers 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663), 22afe6ff61a54e6185bced83e7fb8da5 (127.11.70.193:34111)
I20260808 05:03:13.465893 13512 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0e6fd9815024bcebc9e9f3f19facb75" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61d2874746284278aee2e2eb98b3b69b"
I20260808 05:03:13.465911 13306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0e6fd9815024bcebc9e9f3f19facb75" candidate_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "22afe6ff61a54e6185bced83e7fb8da5"
I20260808 05:03:13.465988 13306 raft_consensus.cc:3037] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:13.465991 13512 raft_consensus.cc:3037] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:13.466689 13512 raft_consensus.cc:2454] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 1.
I20260808 05:03:13.466737 13306 raft_consensus.cc:2454] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bd313dd26f2d456ab3b9a5f70f3912e4 in term 1.
I20260808 05:03:13.466873 13619 leader_election.cc:302] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61d2874746284278aee2e2eb98b3b69b, bd313dd26f2d456ab3b9a5f70f3912e4; no voters:
I20260808 05:03:13.466958 13812 raft_consensus.cc:2781] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:13.467000 13812 raft_consensus.cc:686] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 LEADER]: Becoming Leader. State: Replica: bd313dd26f2d456ab3b9a5f70f3912e4, State: Running, Role: LEADER
I20260808 05:03:13.467047 13812 consensus_queue.cc:237] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } }
I20260808 05:03:13.467353 13819 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: TxnStatusTablet state changed. Reason: New leader bd313dd26f2d456ab3b9a5f70f3912e4. Latest consensus state: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.467447 13819 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:03:13.467600 13868 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 05:03:13.467751 13868 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 05:03:13.467962 13091 catalog_manager.cc:5495] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bd313dd26f2d456ab3b9a5f70f3912e4 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } health_report { overall_health: UNKNOWN } } }
I20260808 05:03:13.515220 13863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.512456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:43401 (local address 127.0.0.1:33638)
0808 05:03:13.512552 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:13.512564 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:13.512612 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:13.512805 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:13.512806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:13.512807 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:13.512855 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.512857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.513764 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.513765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.514328 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.514330 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.514816 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.514817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.514869 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.514885 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:13.515060 (+ 175us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:13.515067 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 05:03:13.515104 (+ 37us) client_negotiation.cc:240] Negotiation successful
0808 05:03:13.515146 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260808 05:03:13.515231 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.512547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33638 (local address 127.11.70.195:43401)
0808 05:03:13.512611 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.512613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.512627 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:03:13.512698 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.512699 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.512710 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.512791 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:13.512921 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.513672 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.514409 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.514737 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.514808 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.514966 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:13.515000 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:13.515051 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.515121 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.515146 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:03:13.516325 13306 raft_consensus.cc:1261] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Refusing update from remote peer bd313dd26f2d456ab3b9a5f70f3912e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:13.516347 13512 raft_consensus.cc:1261] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Refusing update from remote peer bd313dd26f2d456ab3b9a5f70f3912e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:13.516592 13819 consensus_queue.cc:1035] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:13.516708 13812 consensus_queue.cc:1035] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:13.517217 13809 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: TxnStatusTablet state changed. Reason: New leader bd313dd26f2d456ab3b9a5f70f3912e4. Latest consensus state: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.517215 13816 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: TxnStatusTablet state changed. Reason: New leader bd313dd26f2d456ab3b9a5f70f3912e4. Latest consensus state: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.517308 13809 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:13.517328 13816 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:13.517817 13812 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.517904 13812 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:03:13.518209 13819 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.518302 13819 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P bd313dd26f2d456ab3b9a5f70f3912e4: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:03:13.518579 13816 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.518680 13816 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P 22afe6ff61a54e6185bced83e7fb8da5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:13.519381 13809 tablet_replica.cc:439] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 } } peers { permanent_uuid: "bd313dd26f2d456ab3b9a5f70f3912e4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 43401 } } peers { permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 } } }
I20260808 05:03:13.519480 13809 tablet_replica.cc:442] T b0e6fd9815024bcebc9e9f3f19facb75 P 61d2874746284278aee2e2eb98b3b69b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:13.525153 13800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.522433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:51347 (local address 127.11.70.195:43401)
0808 05:03:13.522494 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.522496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.522694 (+ 198us) server_negotiation.cc:407] Connection header received
0808 05:03:13.522720 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.522721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.522733 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.522794 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:13.522947 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.523378 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.524460 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.524664 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.524730 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.524926 (+ 196us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:13.524952 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:13.525000 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.525077 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.525099 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":37}
I20260808 05:03:13.525252 13880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.522370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:43401 (local address 127.11.70.195:51347)
0808 05:03:13.522564 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:13.522577 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:13.522644 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:13.522829 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:13.522830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:13.522832 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:13.522877 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.522878 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.523458 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.523459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.524351 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:13.524354 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.524754 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.524755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:13.524814 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.524833 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:13.525019 (+ 186us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:13.525021 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:03:13.525076 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 05:03:13.525136 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":76,"threads_started":1}
I20260808 05:03:13.527765 13512 raft_consensus.cc:1261] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Refusing update from remote peer bd313dd26f2d456ab3b9a5f70f3912e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:13.527797 13306 raft_consensus.cc:1261] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Refusing update from remote peer bd313dd26f2d456ab3b9a5f70f3912e4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:13.527959 13877 consensus_queue.cc:1035] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61d2874746284278aee2e2eb98b3b69b" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 33663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:13.528121 13819 consensus_queue.cc:1035] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "22afe6ff61a54e6185bced83e7fb8da5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:13.542563 13090 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:13.542680 13090 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50980:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:13.543365 13090 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6730dadbfc974f4383bd7d51365a7038: Sending DeleteTablet for 3 replicas of tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce
I20260808 05:03:13.543610 13685 tablet_service.cc:1514] Processing DeleteTablet for tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:13 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:52608
I20260808 05:03:13.543704 13845 tablet_replica.cc:330] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: stopping tablet replica
I20260808 05:03:13.543694 13277 tablet_service.cc:1514] Processing DeleteTablet for tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:13 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:51724
I20260808 05:03:13.543753 13845 raft_consensus.cc:2229] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:13.543777 13846 tablet_replica.cc:330] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: stopping tablet replica
I20260808 05:03:13.543751 13485 tablet_service.cc:1514] Processing DeleteTablet for tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:13 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:57784
I20260808 05:03:13.543819 13846 raft_consensus.cc:2229] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:13.543831 13845 raft_consensus.cc:2258] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:13.543849 13846 raft_consensus.cc:2258] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:13.543859 13843 tablet_replica.cc:330] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: stopping tablet replica
I20260808 05:03:13.543905 13843 raft_consensus.cc:2229] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:13.543939 13843 raft_consensus.cc:2258] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:13.544238 13845 ts_tablet_manager.cc:1905] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:13.545001 13843 ts_tablet_manager.cc:1905] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:13.545845 13845 ts_tablet_manager.cc:1918] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:13.545904 13845 log.cc:1196] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/63ac0caf2e7b409eaf0dc72c7ca5cfce
I20260808 05:03:13.546200 13845 ts_tablet_manager.cc:1939] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P bd313dd26f2d456ab3b9a5f70f3912e4: Deleting consensus metadata
I20260808 05:03:13.546525 13077 catalog_manager.cc:4841] TS bd313dd26f2d456ab3b9a5f70f3912e4 (127.11.70.195:43401): tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce (table test-table [id=c02e25e3fcca474b92e96f9653452fd9]) successfully deleted
I20260808 05:03:13.546723 13843 ts_tablet_manager.cc:1918] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:13.546792 13843 log.cc:1196] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/63ac0caf2e7b409eaf0dc72c7ca5cfce
I20260808 05:03:13.547015 13843 ts_tablet_manager.cc:1939] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 61d2874746284278aee2e2eb98b3b69b: Deleting consensus metadata
I20260808 05:03:13.547346 13076 catalog_manager.cc:4841] TS 61d2874746284278aee2e2eb98b3b69b (127.11.70.194:33663): tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce (table test-table [id=c02e25e3fcca474b92e96f9653452fd9]) successfully deleted
I20260808 05:03:13.547642 13846 ts_tablet_manager.cc:1905] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:13.549250 13846 ts_tablet_manager.cc:1918] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:13.549324 13846 log.cc:1196] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/63ac0caf2e7b409eaf0dc72c7ca5cfce
I20260808 05:03:13.549540 13846 ts_tablet_manager.cc:1939] T 63ac0caf2e7b409eaf0dc72c7ca5cfce P 22afe6ff61a54e6185bced83e7fb8da5: Deleting consensus metadata
I20260808 05:03:13.549903 13073 catalog_manager.cc:4841] TS 22afe6ff61a54e6185bced83e7fb8da5 (127.11.70.193:34111): tablet 63ac0caf2e7b409eaf0dc72c7ca5cfce (table test-table [id=c02e25e3fcca474b92e96f9653452fd9]) successfully deleted
Aug 08 05:03:13 dist-test-slave-7kzw krb5kdc[13032](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165392, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:13.559300 13887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.547500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39402 (local address 127.11.70.193:34111)
0808 05:03:13.547601 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.547603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.550152 (+ 2549us) server_negotiation.cc:407] Connection header received
0808 05:03:13.550230 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.550231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.550244 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.550298 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:13.551071 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.551569 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.552280 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.552495 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.552573 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.555980 (+ 3407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:13.555991 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:13.555991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:13.555999 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:13.558042 (+ 2043us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:13.558400 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:13.558404 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:13.558405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:13.558503 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:13.558705 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:13.558706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:13.558706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:13.558891 (+ 185us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:13.559060 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.559114 (+ 54us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.559200 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":60,"threads_started":1}
W20260808 05:03:13.559644 13367 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:39402
I20260808 05:03:13.566834 13186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:13.560684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50042 (local address 127.11.70.254:33679)
0808 05:03:13.560734 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:13.560736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:13.560887 (+ 151us) server_negotiation.cc:407] Connection header received
0808 05:03:13.560937 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:13.560937 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:13.560949 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:13.561006 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:13.561491 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.561985 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.562751 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:13.562952 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:13.563029 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:13.564200 (+ 1171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:13.564202 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:13.564203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:13.564210 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:13.565548 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:13.565962 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:13.565963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:13.565963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:13.566026 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:13.566229 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:13.566230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:13.566231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:13.566347 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:13.566456 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:13.566631 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 05:03:13.566709 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 05:03:13.567034 13090 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50042
I20260808 05:03:13.567637 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 13190
I20260808 05:03:13.582542 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 13390
I20260808 05:03:13.598534 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 13597
I20260808 05:03:13.607915 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 13049
2026-08-08T05:03:13Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2746 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:13 dist-test-slave-7kzw krb5kdc[13893](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:13 dist-test-slave-7kzw krb5kdc[13893](info): set up 2 sockets
Aug 08 05:03:13 dist-test-slave-7kzw krb5kdc[13893](info): commencing operation
krb5kdc: starting...
W20260808 05:03:14.839200 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:14 dist-test-slave-7kzw krb5kdc[13893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:14.964962 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:32977
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:32977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:15.052369 13911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:15.052567 13911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:15.052589 13911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:15.053650 13911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:15.053686 13911 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 05:03:15.053699 13911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:15.053712 13911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:15.053725 13911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:15.053736 13911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:15.055223 13911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:32977
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:32977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13911
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:15.055413 13911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:15.055580 13911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:15.060564 13918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:15.060604 13919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:15.060585 13911 server_base.cc:1034] running on GCE node
W20260808 05:03:15.060570 13923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:15.061113 13911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:15.061411 13911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:15.062531 13911 hybrid_clock.cc:648] HybridClock initialized: now 1786165395062512 us; error 53 us; skew 500 ppm
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:15.064980 13911 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:15.065405 13911 webserver.cc:460] Webserver started at http://127.11.70.254:43625/ using document root <none> and password file <none>
I20260808 05:03:15.065629 13911 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:15.065698 13911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:15.065851 13911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:15.067003 13911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "5d5eba6beda74fa3ad10a4d6ab690d05"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "0e870cfce705fc4b23ec94e7aee40fa4"
server_key_iv: "5c8b345a520ef1d48d5e913bd5e7632a"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.067397 13911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "5d5eba6beda74fa3ad10a4d6ab690d05"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "0e870cfce705fc4b23ec94e7aee40fa4"
server_key_iv: "5c8b345a520ef1d48d5e913bd5e7632a"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.068714 13911 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:15.069406 13937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.069581 13911 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:15.069682 13911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "5d5eba6beda74fa3ad10a4d6ab690d05"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "0e870cfce705fc4b23ec94e7aee40fa4"
server_key_iv: "5c8b345a520ef1d48d5e913bd5e7632a"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.069765 13911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:15.090644 13911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:15.092729 13911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:15.092918 13911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:15.097579 13911 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:32977
I20260808 05:03:15.097724 14025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:32977 every 8 connection(s)
I20260808 05:03:15.098006 13911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:15.098800 14026 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.100989 14026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05: Bootstrap starting.
I20260808 05:03:15.101337 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 13911
I20260808 05:03:15.101449 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:15.101616 11547 external_mini_cluster.cc:1428] Setting key 24ad26d6cd2fd66109c6becd84ce258e
I20260808 05:03:15.101665 14026 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.102033 14026 log.cc:824] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:15.102870 14026 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05: No bootstrap required, opened a new log
I20260808 05:03:15.104573 14026 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5eba6beda74fa3ad10a4d6ab690d05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 32977 } }
I20260808 05:03:15.104739 14026 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.104787 14026 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d5eba6beda74fa3ad10a4d6ab690d05, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.104921 14026 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5eba6beda74fa3ad10a4d6ab690d05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 32977 } }
I20260808 05:03:15.105019 14026 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:15.105063 14026 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:15.105126 14026 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.105806 14026 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5eba6beda74fa3ad10a4d6ab690d05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 32977 } }
I20260808 05:03:15.105922 14026 leader_election.cc:302] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5d5eba6beda74fa3ad10a4d6ab690d05; no voters:
I20260808 05:03:15.106082 14026 leader_election.cc:288] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:15.106166 14033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:15.106353 14026 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:15.106350 14033 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [term 1 LEADER]: Becoming Leader. State: Replica: 5d5eba6beda74fa3ad10a4d6ab690d05, State: Running, Role: LEADER
I20260808 05:03:15.106588 14033 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5eba6beda74fa3ad10a4d6ab690d05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 32977 } }
I20260808 05:03:15.106962 14033 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5d5eba6beda74fa3ad10a4d6ab690d05. Latest consensus state: current_term: 1 leader_uuid: "5d5eba6beda74fa3ad10a4d6ab690d05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5eba6beda74fa3ad10a4d6ab690d05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 32977 } } }
I20260808 05:03:15.107081 14034 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5d5eba6beda74fa3ad10a4d6ab690d05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5d5eba6beda74fa3ad10a4d6ab690d05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 32977 } } }
I20260808 05:03:15.107143 14033 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:15.107218 14034 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:15.107393 14042 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:15.107975 14042 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165394, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:15.109609 14042 catalog_manager.cc:1347] Generated new cluster ID: 11c65dabfd8b40e8bafc9ef67b14748d
I20260808 05:03:15.109656 14042 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:15.113559 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.102134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56092 (local address 127.11.70.254:32977)
0808 05:03:15.102316 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.102324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.102349 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:03:15.102846 (+ 497us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.102852 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.102900 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.103057 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:15.103789 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.105281 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.106376 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.107051 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.107320 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.110085 (+ 2765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:15.110089 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:15.110089 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:15.110100 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:15.111951 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.112293 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.112296 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.112296 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.112400 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.112590 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.112591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.112591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.112873 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:15.113011 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.113233 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.113367 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260808 05:03:15.116001 14042 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:15.116652 14042 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:15.122042 14042 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05: Generated new TSK 0
I20260808 05:03:15.122217 14042 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:15.154023 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:32977
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:15.237500 14059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:15.237708 14059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:15.237732 14059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:15.238940 14059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:15.238982 14059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:15.239002 14059 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 05:03:15.239014 14059 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:03:15.239032 14059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:15.240450 14059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.70.254:32977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:15.240633 14059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:15.240810 14059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:15.245884 14065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:15.245968 14059 server_base.cc:1034] running on GCE node
W20260808 05:03:15.245920 14069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:15.246047 14066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:15.246336 14059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:15.246616 14059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:15.247789 14059 hybrid_clock.cc:648] HybridClock initialized: now 1786165395247776 us; error 44 us; skew 500 ppm
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:15.250319 14059 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:15.250851 14059 webserver.cc:460] Webserver started at http://127.11.70.193:39965/ using document root <none> and password file <none>
I20260808 05:03:15.251091 14059 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:15.251160 14059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:15.251305 14059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:15.252336 14059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "15cbe593f95a452da1bde3d4898a7859"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "7c9f7772293eac51ac0e2f91e7ce542a"
server_key_iv: "f4ca15185117095b4f1066f978347a73"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.252755 14059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "15cbe593f95a452da1bde3d4898a7859"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "7c9f7772293eac51ac0e2f91e7ce542a"
server_key_iv: "f4ca15185117095b4f1066f978347a73"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.254098 14059 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:15.254906 14078 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.255079 14059 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.255187 14059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "15cbe593f95a452da1bde3d4898a7859"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "7c9f7772293eac51ac0e2f91e7ce542a"
server_key_iv: "f4ca15185117095b4f1066f978347a73"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.255272 14059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:15.282552 14059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:15.284426 14059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:15.284597 14059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:15.285269 14059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:15.285321 14059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.285360 14059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:15.285374 14059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:15.293517 14059 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:37315
I20260808 05:03:15.293547 14241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:37315 every 8 connection(s)
I20260808 05:03:15.293985 14059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:15.295715 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.285796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:59819 (local address 127.11.70.254:32977)
0808 05:03:15.285878 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.285880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.286150 (+ 270us) server_negotiation.cc:407] Connection header received
0808 05:03:15.286945 (+ 795us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.286945 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.286956 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.287010 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:15.288009 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.288550 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.289690 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.289898 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.289976 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.292713 (+ 2737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:15.292715 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:15.292715 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:15.292723 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:15.294579 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.294971 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.294972 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.294972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.295028 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.295206 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.295206 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.295206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.295314 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:15.295371 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.295579 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.295648 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:03:15.295858 14089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.285770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:32977 (local address 127.11.70.193:59819)
0808 05:03:15.285995 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.286045 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.286804 (+ 759us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.287108 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.287113 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.287541 (+ 428us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:15.287918 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.287926 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.288687 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.288688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.289578 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.289580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.289988 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.289989 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.290154 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.290722 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:15.290732 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:15.292611 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:15.294647 (+ 2036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.294679 (+ 32us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.294681 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.294903 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.295068 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.295069 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.295069 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.295154 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.295363 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:15.295366 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:15.295473 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.295549 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.295676 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":116,"threads_started":1}
I20260808 05:03:15.296356 14243 heartbeater.cc:347] Connected to a master server at 127.11.70.254:32977
I20260808 05:03:15.296445 14243 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:15.296633 14243 heartbeater.cc:511] Master 127.11.70.254:32977 requested a full tablet report, sending...
I20260808 05:03:15.297231 13956 ts_manager.cc:194] Registered new tserver with Master: 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193:37315)
I20260808 05:03:15.298161 13956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:59819
I20260808 05:03:15.299597 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 14059
I20260808 05:03:15.299707 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:15.299908 11547 external_mini_cluster.cc:1428] Setting key 56b55d580314867b862405bbcde47e00
I20260808 05:03:15.303781 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.297554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:58279 (local address 127.11.70.254:32977)
0808 05:03:15.297596 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.297598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.297712 (+ 114us) server_negotiation.cc:407] Connection header received
0808 05:03:15.297780 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.297780 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.297788 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.297827 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:15.298154 (+ 327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.298893 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.299606 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.299912 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.300001 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.300953 (+ 952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:15.300955 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:15.300955 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:15.300963 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:15.302566 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.303019 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.303020 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.303020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.303073 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.303310 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.303311 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.303312 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.303425 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:15.303497 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.303655 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.303722 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:03:15.303875 14250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.297466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:32977 (local address 127.11.70.193:58279)
0808 05:03:15.297646 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.297657 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.297717 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.297840 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.297840 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.298028 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:15.298089 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.298090 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.298999 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.299000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.299504 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.299505 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.300004 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.300005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.300087 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.300495 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:15.300500 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:15.300863 (+ 363us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:15.302665 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.302667 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.302668 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.302934 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.303141 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.303142 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.303142 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.303218 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.303500 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:15.303501 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:15.303554 (+ 53us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.303637 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.303743 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:15.326772 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:32977
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:15.410005 14253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:15.410248 14253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:15.410293 14253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:15.411464 14253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:15.411531 14253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:15.411567 14253 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 05:03:15.411595 14253 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:03:15.411626 14253 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:15.413096 14253 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.70.254:32977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:15.413363 14253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:15.413606 14253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:03:15.418884 14253 server_base.cc:1034] running on GCE node
W20260808 05:03:15.418857 14258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:15.418937 14259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:15.418857 14261 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:15.419309 14253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:15.419523 14253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:15.420672 14253 hybrid_clock.cc:648] HybridClock initialized: now 1786165395420656 us; error 28 us; skew 500 ppm
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:15.423313 14253 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:15.423758 14253 webserver.cc:460] Webserver started at http://127.11.70.194:44615/ using document root <none> and password file <none>
I20260808 05:03:15.424011 14253 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:15.424057 14253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:15.424218 14253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:15.425354 14253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "f26d5b81008742909ba1c145ec061b00"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "e48070b76b1bc44e1669d33b14d805da"
server_key_iv: "418a0deeaf9e1587651916a2033925b7"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.425729 14253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "f26d5b81008742909ba1c145ec061b00"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "e48070b76b1bc44e1669d33b14d805da"
server_key_iv: "418a0deeaf9e1587651916a2033925b7"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.427238 14253 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:15.427961 14271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.428169 14253 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:15.428258 14253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "f26d5b81008742909ba1c145ec061b00"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "e48070b76b1bc44e1669d33b14d805da"
server_key_iv: "418a0deeaf9e1587651916a2033925b7"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.428332 14253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:15.445258 14253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:15.447201 14253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:15.447386 14253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:15.447901 14253 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:15.447968 14253 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.448009 14253 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:15.448058 14253 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:15.455324 14253 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:41867
I20260808 05:03:15.455406 14438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:41867 every 8 connection(s)
I20260808 05:03:15.455741 14253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:15.458552 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.448466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:44755 (local address 127.11.70.254:32977)
0808 05:03:15.448532 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.448534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.448759 (+ 225us) server_negotiation.cc:407] Connection header received
0808 05:03:15.449313 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.449314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.449329 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.449390 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:15.450366 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.451213 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.452274 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.452586 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.452653 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.455476 (+ 2823us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:15.455478 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:15.455478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:15.455487 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:15.457099 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.457525 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.457526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.457527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.457594 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.457920 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.457921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.457922 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.458041 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:15.458105 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.458351 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.458421 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:03:15.458740 14285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.448447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:32977 (local address 127.11.70.194:44755)
0808 05:03:15.448613 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.448672 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.449190 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.449520 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.449524 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.449936 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:15.450249 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.450255 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.451351 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.451353 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.452175 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.452177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.452671 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.452671 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.452815 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.453394 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:15.453404 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:15.455371 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:15.457205 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.457213 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.457215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.457443 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.457671 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.457672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.457672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.457791 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.458108 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:15.458113 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:15.458230 (+ 117us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.458316 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.458436 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260808 05:03:15.459316 14439 heartbeater.cc:347] Connected to a master server at 127.11.70.254:32977
I20260808 05:03:15.459421 14439 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:15.459599 14439 heartbeater.cc:511] Master 127.11.70.254:32977 requested a full tablet report, sending...
I20260808 05:03:15.459978 13956 ts_manager.cc:194] Registered new tserver with Master: f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867)
I20260808 05:03:15.460500 13956 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:44755
I20260808 05:03:15.461540 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 14253
I20260808 05:03:15.461660 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:15.461846 11547 external_mini_cluster.cc:1428] Setting key ceaa5a9d4131ee643c43f9113ef22ff0
I20260808 05:03:15.466291 14446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.460279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:32977 (local address 127.11.70.194:47917)
0808 05:03:15.460419 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.460430 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.460490 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.460655 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.460656 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.460878 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:15.460947 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.460949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.461732 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.461733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.462376 (+ 643us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.462378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.462843 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.462844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.462902 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.463332 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:15.463336 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:15.463601 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:15.465168 (+ 1567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.465169 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.465170 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.465403 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.465602 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.465602 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.465603 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.465680 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.466041 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:15.466042 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:15.466080 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.466136 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.466214 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260808 05:03:15.466428 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.460373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:47917 (local address 127.11.70.254:32977)
0808 05:03:15.460412 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.460413 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.460477 (+ 64us) server_negotiation.cc:407] Connection header received
0808 05:03:15.460544 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.460544 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.460552 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.460627 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:15.461023 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.461613 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.462487 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.462764 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.462838 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.463687 (+ 849us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:15.463689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:15.463689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:15.463697 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:15.465082 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.465479 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.465479 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.465480 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.465531 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.465762 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.465763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.465763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.465963 (+ 200us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:15.466035 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.466210 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.466297 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:15.490202 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:32977
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:15.573832 14453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:15.574030 14453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:15.574055 14453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:15.575223 14453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:15.575276 14453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:15.575299 14453 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 05:03:15.575309 14453 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:03:15.575327 14453 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:15.576778 14453 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.70.254:32977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:15.577000 14453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:15.577253 14453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:03:15.582590 14453 server_base.cc:1034] running on GCE node
W20260808 05:03:15.582648 14461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:15.582809 14459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:15.582641 14465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:15.583210 14453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:15.583480 14453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:15.584687 14453 hybrid_clock.cc:648] HybridClock initialized: now 1786165395584672 us; error 35 us; skew 500 ppm
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:15.587550 14453 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:15.588063 14453 webserver.cc:460] Webserver started at http://127.11.70.195:36141/ using document root <none> and password file <none>
I20260808 05:03:15.588313 14453 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:15.588392 14453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:15.588568 14453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:15.589691 14453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "5f3cc0c1181542a9b4f145e3d13f1f11"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "5a2f48a529c304a1971aa4089c1df4cb"
server_key_iv: "74b8fbfb5ac4dd3f1cf67715bff3ba4c"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.590097 14453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "5f3cc0c1181542a9b4f145e3d13f1f11"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "5a2f48a529c304a1971aa4089c1df4cb"
server_key_iv: "74b8fbfb5ac4dd3f1cf67715bff3ba4c"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.591742 14453 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:15.592517 14472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.592720 14453 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:15.592842 14453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "5f3cc0c1181542a9b4f145e3d13f1f11"
format_stamp: "Formatted at 2026-08-08 05:03:15 on dist-test-slave-7kzw"
server_key: "5a2f48a529c304a1971aa4089c1df4cb"
server_key_iv: "74b8fbfb5ac4dd3f1cf67715bff3ba4c"
server_key_version: "encryptionkey@0"
I20260808 05:03:15.592922 14453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:15.604939 14453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:15.607275 14453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:15.607471 14453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:15.607960 14453 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:15.608007 14453 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.608089 14453 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:15.608124 14453 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:15.615314 14453 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:36105
I20260808 05:03:15.615406 14634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:36105 every 8 connection(s)
I20260808 05:03:15.615700 14453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:03:15.615911 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 14453
I20260808 05:03:15.616007 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:15.616241 11547 external_mini_cluster.cc:1428] Setting key 7005628f03e92e8bbd308e22b637dee1
I20260808 05:03:15.619011 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.608543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:42501 (local address 127.11.70.254:32977)
0808 05:03:15.608583 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.608586 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.608862 (+ 276us) server_negotiation.cc:407] Connection header received
0808 05:03:15.609364 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.609366 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.609381 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.609462 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:15.610363 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.611219 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.612811 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.613135 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.613207 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.615893 (+ 2686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:15.615895 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:15.615896 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:15.615906 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:15.617747 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.618176 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.618177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.618178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.618245 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.618444 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.618445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.618445 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.618610 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:15.618665 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.618877 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.618946 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:03:15.619151 14488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.608566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:32977 (local address 127.11.70.195:42501)
0808 05:03:15.608752 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.608787 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.609260 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.609557 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.609561 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.609960 (+ 399us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:15.610250 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.610257 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.611342 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.611343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.612716 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.612719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.613216 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.613217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.613358 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.613913 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:15.613925 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:15.615789 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:15.617862 (+ 2073us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.617869 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.617872 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.618107 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.618299 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.618300 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.618300 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.618390 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.618655 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:15.618659 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:15.618766 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.618846 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.618963 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":100,"threads_started":1}
I20260808 05:03:15.619772 14635 heartbeater.cc:347] Connected to a master server at 127.11.70.254:32977
I20260808 05:03:15.619858 14635 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:15.620056 14635 heartbeater.cc:511] Master 127.11.70.254:32977 requested a full tablet report, sending...
I20260808 05:03:15.620429 13958 ts_manager.cc:194] Registered new tserver with Master: 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105)
I20260808 05:03:15.620967 13958 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:42501
I20260808 05:03:15.626118 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.620871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:57231 (local address 127.11.70.254:32977)
0808 05:03:15.620909 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.620910 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.620955 (+ 45us) server_negotiation.cc:407] Connection header received
0808 05:03:15.621018 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.621019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.621042 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.621098 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:15.621493 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.621948 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.622716 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.622889 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.622945 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.623765 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:15.623766 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:15.623766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:15.623772 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:15.625191 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.625496 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.625497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.625497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.625546 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.625709 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.625710 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.625710 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.625793 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:15.625840 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.626006 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.626062 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:03:15.626142 14645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.620756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:32977 (local address 127.11.70.195:57231)
0808 05:03:15.620891 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.620901 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.620964 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.621148 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.621149 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.621348 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:15.621414 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.621415 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.622050 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.622051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.622646 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.622648 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.622956 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.622956 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.623011 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.623343 (+ 332us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:15.623347 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:15.623635 (+ 288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:15.625270 (+ 1635us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.625271 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.625271 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.625431 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.625612 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.625612 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.625613 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.625664 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.625870 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:15.625871 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:15.625914 (+ 43us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.625987 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.626068 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":83,"threads_started":1}
I20260808 05:03:15.628211 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:15.652686 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.645615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56102 (local address 127.11.70.254:32977)
0808 05:03:15.645685 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.645687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.645702 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:03:15.645813 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.645814 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.645825 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.645886 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:15.646432 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.647021 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.647805 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.647989 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.648047 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.650280 (+ 2233us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:15.650281 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:15.650281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:15.650288 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:15.651686 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.652014 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.652015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.652015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.652066 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.652248 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.652249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.652249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.652347 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:15.652418 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.652517 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.652577 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:03:15.654299 13958 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:15.655970 13958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:15.663172 14664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.658299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:36105 (local address 127.0.0.1:49656)
0808 05:03:15.658758 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.658769 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.658826 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.659388 (+ 562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.659388 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.659390 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:15.659424 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.659426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.660651 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.660652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.661780 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.661783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.662852 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.662853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.662941 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.662956 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.663025 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.663093 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":438,"mutex_wait_us":11,"thread_start_us":143,"threads_started":1}
I20260808 05:03:15.663429 14665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.658311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:41867 (local address 127.0.0.1:50732)
0808 05:03:15.658793 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.658803 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.658842 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.659079 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.659080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.659083 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:15.659162 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.659163 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.660581 (+ 1418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.660582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.661780 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.661783 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.662851 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.662852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.662941 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.662956 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.663025 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.663370 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":306,"thread_start_us":95,"threads_started":1}
I20260808 05:03:15.663451 14674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.658646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50732 (local address 127.11.70.194:41867)
0808 05:03:15.658862 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.658867 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.658879 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:03:15.658917 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.658918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.658940 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.659034 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:15.659256 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.660483 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.661887 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.662681 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.662754 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.662811 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.663078 (+ 267us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.663126 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":83,"threads_started":1}
I20260808 05:03:15.663678 14667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.658299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:37315 (local address 127.0.0.1:42100)
0808 05:03:15.658569 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.658616 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.658684 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.659029 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.659032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.659034 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:15.659217 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.659220 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.660161 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.660162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.661904 (+ 1742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.661908 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.663085 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.663086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.663158 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.663164 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.663218 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.663563 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":154,"threads_started":1}
I20260808 05:03:15.663712 14668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.658556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49656 (local address 127.11.70.195:36105)
0808 05:03:15.659169 (+ 613us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.659174 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.659184 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:15.659223 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.659225 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.659241 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.659314 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:15.659503 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.660558 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.661887 (+ 1329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.662681 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.662754 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.662811 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.663547 (+ 736us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.663611 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":97,"threads_started":1}
I20260808 05:03:15.664029 14669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.658561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42100 (local address 127.11.70.193:37315)
0808 05:03:15.658849 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.658854 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.658864 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:15.658905 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.658907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.658922 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.659025 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:15.659311 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.660072 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.662010 (+ 1938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.662906 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.662984 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.663044 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.663853 (+ 809us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.663911 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":130,"threads_started":1}
I20260808 05:03:15.664470 14547 tablet_service.cc:1467] Processing CreateTablet for tablet 88cd9e1b9b994fc6886f395cb0337361 (DEFAULT_TABLE table=test-table [id=ea6c3cf595ee44328946eac621cea28c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:15.664628 14146 tablet_service.cc:1467] Processing CreateTablet for tablet 88cd9e1b9b994fc6886f395cb0337361 (DEFAULT_TABLE table=test-table [id=ea6c3cf595ee44328946eac621cea28c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:15.664892 14547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88cd9e1b9b994fc6886f395cb0337361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.664934 14146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88cd9e1b9b994fc6886f395cb0337361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.668322 14675 tablet_bootstrap.cc:492] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: Bootstrap starting.
I20260808 05:03:15.669256 14349 tablet_service.cc:1467] Processing CreateTablet for tablet 88cd9e1b9b994fc6886f395cb0337361 (DEFAULT_TABLE table=test-table [id=ea6c3cf595ee44328946eac621cea28c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:15.669407 14675 tablet_bootstrap.cc:654] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.669621 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88cd9e1b9b994fc6886f395cb0337361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.669781 14675 log.cc:824] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:15.670181 14677 tablet_bootstrap.cc:492] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: Bootstrap starting.
I20260808 05:03:15.670666 14675 tablet_bootstrap.cc:492] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: No bootstrap required, opened a new log
I20260808 05:03:15.670727 14675 ts_tablet_manager.cc:1397] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:15.670921 14677 tablet_bootstrap.cc:654] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.671392 14677 log.cc:824] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:15.672207 14677 tablet_bootstrap.cc:492] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: No bootstrap required, opened a new log
I20260808 05:03:15.672279 14677 ts_tablet_manager.cc:1397] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:15.672991 14675 raft_consensus.cc:348] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } }
I20260808 05:03:15.673139 14675 raft_consensus.cc:374] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.673193 14675 raft_consensus.cc:729] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3cc0c1181542a9b4f145e3d13f1f11, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.673309 14675 consensus_queue.cc:260] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } }
I20260808 05:03:15.673630 14635 heartbeater.cc:503] Master 127.11.70.254:32977 was elected leader, sending a full tablet report...
I20260808 05:03:15.673791 14681 tablet_bootstrap.cc:492] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: Bootstrap starting.
I20260808 05:03:15.673996 14675 ts_tablet_manager.cc:1428] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:03:15.674427 14681 tablet_bootstrap.cc:654] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.674515 14677 raft_consensus.cc:348] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } }
I20260808 05:03:15.674700 14677 raft_consensus.cc:374] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.674747 14677 raft_consensus.cc:729] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15cbe593f95a452da1bde3d4898a7859, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.674794 14681 log.cc:824] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:15.674870 14677 consensus_queue.cc:260] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } }
I20260808 05:03:15.675143 14677 ts_tablet_manager.cc:1428] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:03:15.675166 14243 heartbeater.cc:503] Master 127.11.70.254:32977 was elected leader, sending a full tablet report...
I20260808 05:03:15.675736 14681 tablet_bootstrap.cc:492] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: No bootstrap required, opened a new log
I20260808 05:03:15.675810 14681 ts_tablet_manager.cc:1397] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:03:15.677323 14681 raft_consensus.cc:348] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } }
I20260808 05:03:15.677443 14681 raft_consensus.cc:374] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.677464 14681 raft_consensus.cc:729] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26d5b81008742909ba1c145ec061b00, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.677533 14681 consensus_queue.cc:260] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } }
I20260808 05:03:15.677721 14681 ts_tablet_manager.cc:1428] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:03:15.677803 14439 heartbeater.cc:503] Master 127.11.70.254:32977 was elected leader, sending a full tablet report...
W20260808 05:03:15.706477 14440 tablet.cc:2369] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:15.725662 14684 raft_consensus.cc:482] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:15.725800 14684 raft_consensus.cc:504] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } }
I20260808 05:03:15.726117 14684 leader_election.cc:288] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105), f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867)
I20260808 05:03:15.729147 14668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.726432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:43025 (local address 127.11.70.195:36105)
0808 05:03:15.726505 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.726508 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.726518 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:15.726554 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.726555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.726563 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.726618 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:15.726828 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.727448 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.728388 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.728772 (+ 384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.728862 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.728872 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.729038 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.729075 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:03:15.729147 14089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.726337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:36105 (local address 127.11.70.193:43025)
0808 05:03:15.726383 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.726395 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.726441 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.726654 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.726656 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.726658 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:15.726737 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.726742 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.727542 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.727543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.728291 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.728293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.728860 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.728861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.728959 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.728962 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.729029 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.729072 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 05:03:15.729514 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88cd9e1b9b994fc6886f395cb0337361" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" is_pre_election: true
I20260808 05:03:15.729708 14574 raft_consensus.cc:2454] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 0.
I20260808 05:03:15.729723 14687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.726337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:41867 (local address 127.11.70.193:43121)
0808 05:03:15.726765 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.726775 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.726853 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.726974 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.726975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.726976 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:15.727053 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.727055 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.727703 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.727704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.728670 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.728673 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.729423 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.729424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.729494 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.729498 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.729574 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.729617 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":410,"mutex_wait_us":185,"thread_start_us":158,"threads_started":1}
I20260808 05:03:15.729750 14674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.726466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:43121 (local address 127.11.70.194:41867)
0808 05:03:15.726543 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.726546 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.726845 (+ 299us) server_negotiation.cc:407] Connection header received
0808 05:03:15.726908 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.726909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.726918 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.726953 (+ 35us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:15.727128 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.727586 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.728799 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.729256 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.729344 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.729354 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.729585 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.729631 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:03:15.730125 14079 leader_election.cc:302] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15cbe593f95a452da1bde3d4898a7859, 5f3cc0c1181542a9b4f145e3d13f1f11; no voters:
I20260808 05:03:15.730103 14379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88cd9e1b9b994fc6886f395cb0337361" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26d5b81008742909ba1c145ec061b00" is_pre_election: true
I20260808 05:03:15.730253 14379 raft_consensus.cc:2454] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 0.
I20260808 05:03:15.730294 14684 raft_consensus.cc:2781] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:15.730355 14684 raft_consensus.cc:482] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:15.730384 14684 raft_consensus.cc:3037] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.731397 14684 raft_consensus.cc:504] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } }
I20260808 05:03:15.731567 14684 leader_election.cc:288] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 election: Requested vote from peers 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105), f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867)
I20260808 05:03:15.731752 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88cd9e1b9b994fc6886f395cb0337361" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11"
I20260808 05:03:15.731837 14574 raft_consensus.cc:3037] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.732522 14574 raft_consensus.cc:2454] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 1.
I20260808 05:03:15.732617 14379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88cd9e1b9b994fc6886f395cb0337361" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26d5b81008742909ba1c145ec061b00"
I20260808 05:03:15.732717 14379 raft_consensus.cc:3037] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.732793 14079 leader_election.cc:302] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15cbe593f95a452da1bde3d4898a7859, 5f3cc0c1181542a9b4f145e3d13f1f11; no voters:
I20260808 05:03:15.732882 14684 raft_consensus.cc:2781] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:15.733057 14684 raft_consensus.cc:686] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 1 LEADER]: Becoming Leader. State: Replica: 15cbe593f95a452da1bde3d4898a7859, State: Running, Role: LEADER
I20260808 05:03:15.733157 14684 consensus_queue.cc:237] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } }
I20260808 05:03:15.733682 14379 raft_consensus.cc:2454] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 1.
I20260808 05:03:15.734217 13958 catalog_manager.cc:5495] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193). New cstate: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } health_report { overall_health: UNKNOWN } } }
Aug 08 05:03:15 dist-test-slave-7kzw krb5kdc[13893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165395, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:15.774281 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.767221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:32977 (local address 127.0.0.1:56116)
0808 05:03:15.767415 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.767427 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.767492 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.767620 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.767621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.767959 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:15.768012 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.768014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.768636 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.768637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.769181 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.769182 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.769494 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.769494 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.769537 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.770046 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:15.770051 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:15.771456 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:15.773082 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.773091 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.773093 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.773298 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.773533 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:15.773533 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:15.773534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:15.773597 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:15.773857 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:15.773864 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:15.773909 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.773995 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.774117 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":100,"threads_started":1}
I20260808 05:03:15.774279 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.767313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56116 (local address 127.11.70.254:32977)
0808 05:03:15.767413 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.767416 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.767489 (+ 73us) server_negotiation.cc:407] Connection header received
0808 05:03:15.767536 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.767536 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.767546 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.767597 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:15.768076 (+ 479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.768558 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.769252 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.769428 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.769478 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.771559 (+ 2081us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:15.771561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:15.771561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:15.771568 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:15.772986 (+ 1418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.773388 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.773390 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.773391 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.773446 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:15.773675 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:15.773676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:15.773676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:15.773783 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:15.773852 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.774033 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.774168 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":70,"server-negotiator.queue_time_us":68}
I20260808 05:03:15.776521 13958 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:56116:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 05:03:15.776758 13958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:15.778528 14146 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9b886da596410dacad4d8b67074cd9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40733731d1fa4eaea3803bd7e82faf5a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:03:15.778539 14547 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9b886da596410dacad4d8b67074cd9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40733731d1fa4eaea3803bd7e82faf5a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:03:15.778539 14349 tablet_service.cc:1467] Processing CreateTablet for tablet 2e9b886da596410dacad4d8b67074cd9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=40733731d1fa4eaea3803bd7e82faf5a]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:03:15.778746 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9b886da596410dacad4d8b67074cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.778751 14547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9b886da596410dacad4d8b67074cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.778757 14146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e9b886da596410dacad4d8b67074cd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.780161 14677 tablet_bootstrap.cc:492] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: Bootstrap starting.
I20260808 05:03:15.780397 14675 tablet_bootstrap.cc:492] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: Bootstrap starting.
I20260808 05:03:15.780397 14681 tablet_bootstrap.cc:492] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: Bootstrap starting.
I20260808 05:03:15.780654 14677 tablet_bootstrap.cc:654] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.781019 14675 tablet_bootstrap.cc:654] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.781147 14681 tablet_bootstrap.cc:654] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.781827 14675 tablet_bootstrap.cc:492] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: No bootstrap required, opened a new log
I20260808 05:03:15.781881 14675 ts_tablet_manager.cc:1397] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:15.782023 14677 tablet_bootstrap.cc:492] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: No bootstrap required, opened a new log
I20260808 05:03:15.782092 14677 ts_tablet_manager.cc:1397] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:15.782063 14675 raft_consensus.cc:348] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.782148 14675 raft_consensus.cc:374] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.782179 14675 raft_consensus.cc:729] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3cc0c1181542a9b4f145e3d13f1f11, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.782227 14675 consensus_queue.cc:260] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.782347 14675 ts_tablet_manager.cc:1428] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.782300 14677 raft_consensus.cc:348] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.782393 14677 raft_consensus.cc:374] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.782419 14677 raft_consensus.cc:729] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15cbe593f95a452da1bde3d4898a7859, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.782444 14680 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.782562 14680 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:15.782676 14681 tablet_bootstrap.cc:492] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: No bootstrap required, opened a new log
I20260808 05:03:15.782655 14677 consensus_queue.cc:260] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.782732 14681 ts_tablet_manager.cc:1397] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:03:15.782790 14677 ts_tablet_manager.cc:1428] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:15.782872 14681 raft_consensus.cc:348] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.782953 14681 raft_consensus.cc:374] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.782975 14681 raft_consensus.cc:729] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26d5b81008742909ba1c145ec061b00, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.782979 14684 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.783023 14681 consensus_queue.cc:260] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.783082 14684 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:15.783128 14681 ts_tablet_manager.cc:1428] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:15.783295 14685 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.783388 14685 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 05:03:15.794788 14244 tablet.cc:2369] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:15.841077 14684 raft_consensus.cc:482] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:15.841181 14684 raft_consensus.cc:504] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.841373 14684 leader_election.cc:288] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867), 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105)
I20260808 05:03:15.841619 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9b886da596410dacad4d8b67074cd9" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" is_pre_election: true
I20260808 05:03:15.841634 14379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9b886da596410dacad4d8b67074cd9" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26d5b81008742909ba1c145ec061b00" is_pre_election: true
I20260808 05:03:15.841733 14379 raft_consensus.cc:2454] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 0.
I20260808 05:03:15.841739 14574 raft_consensus.cc:2454] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 0.
I20260808 05:03:15.841933 14080 leader_election.cc:302] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15cbe593f95a452da1bde3d4898a7859, f26d5b81008742909ba1c145ec061b00; no voters:
I20260808 05:03:15.842059 14684 raft_consensus.cc:2781] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:15.842103 14684 raft_consensus.cc:482] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:15.842126 14684 raft_consensus.cc:3037] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.842824 14684 raft_consensus.cc:504] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.842967 14684 leader_election.cc:288] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 election: Requested vote from peers f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867), 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105)
I20260808 05:03:15.843153 14574 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9b886da596410dacad4d8b67074cd9" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11"
I20260808 05:03:15.843153 14379 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e9b886da596410dacad4d8b67074cd9" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26d5b81008742909ba1c145ec061b00"
I20260808 05:03:15.843233 14574 raft_consensus.cc:3037] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.843240 14379 raft_consensus.cc:3037] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.844069 14379 raft_consensus.cc:2454] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 1.
I20260808 05:03:15.844069 14574 raft_consensus.cc:2454] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 1.
I20260808 05:03:15.844245 14079 leader_election.cc:302] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15cbe593f95a452da1bde3d4898a7859, 5f3cc0c1181542a9b4f145e3d13f1f11; no voters:
I20260808 05:03:15.844363 14684 raft_consensus.cc:2781] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:15.844412 14684 raft_consensus.cc:686] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [term 1 LEADER]: Becoming Leader. State: Replica: 15cbe593f95a452da1bde3d4898a7859, State: Running, Role: LEADER
I20260808 05:03:15.844463 14684 consensus_queue.cc:237] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.844806 14688 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: TxnStatusTablet state changed. Reason: New leader 15cbe593f95a452da1bde3d4898a7859. Latest consensus state: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.844905 14688 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:03:15.845080 14705 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 05:03:15.845082 13956 catalog_manager.cc:5495] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193). New cstate: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } health_report { overall_health: UNKNOWN } } }
I20260808 05:03:15.845242 14705 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 05:03:15.858814 14696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.855983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:37315 (local address 127.0.0.1:42114)
0808 05:03:15.856057 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.856069 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.856115 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.856378 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.856379 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.856381 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:15.856431 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.856434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.857061 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.857062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.857830 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.857832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.858215 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.858216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.858280 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.858302 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.858620 (+ 318us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.858632 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.858691 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.858741 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 05:03:15.858812 14669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.856193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42114 (local address 127.11.70.193:37315)
0808 05:03:15.856235 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.856237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.856244 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:15.856274 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.856275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.856298 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.856370 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:15.856498 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.856973 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.857909 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.858122 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.858198 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.858406 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.858560 (+ 154us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.858641 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.858716 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.858736 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:15.860875 14574 raft_consensus.cc:1261] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Refusing update from remote peer 15cbe593f95a452da1bde3d4898a7859: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:15.860901 14379 raft_consensus.cc:1261] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Refusing update from remote peer 15cbe593f95a452da1bde3d4898a7859: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:15.861224 14688 consensus_queue.cc:1035] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:15.861352 14684 consensus_queue.cc:1035] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:15.862623 14685 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: TxnStatusTablet state changed. Reason: New leader 15cbe593f95a452da1bde3d4898a7859. Latest consensus state: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.862744 14685 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:15.862757 14680 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: TxnStatusTablet state changed. Reason: New leader 15cbe593f95a452da1bde3d4898a7859. Latest consensus state: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.862864 14680 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:15.864042 14688 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.864135 14688 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:03:15.864347 14710 mvcc.cc:205] Tried to move back new op lower bound from 7316133461443497984 to 7316133461379264512. Current Snapshot: MvccSnapshot[applied={T|T < 7316133461443497984}]
I20260808 05:03:15.864357 14680 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.864435 14680 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P 5f3cc0c1181542a9b4f145e3d13f1f11: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:15.864455 14717 mvcc.cc:205] Tried to move back new op lower bound from 7316133461443497984 to 7316133461379264512. Current Snapshot: MvccSnapshot[applied={T|T < 7316133461443497984}]
I20260808 05:03:15.865684 14684 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.865775 14684 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P 15cbe593f95a452da1bde3d4898a7859: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:03:15.865999 14716 mvcc.cc:205] Tried to move back new op lower bound from 7316133461443497984 to 7316133461379264512. Current Snapshot: MvccSnapshot[applied={T|T < 7316133461443497984}]
W20260808 05:03:15.866343 14637 tablet.cc:2369] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:15.866341 14685 tablet_replica.cc:439] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } } }
I20260808 05:03:15.866432 14685 tablet_replica.cc:442] T 2e9b886da596410dacad4d8b67074cd9 P f26d5b81008742909ba1c145ec061b00: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:15.869726 14669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.867231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42130 (local address 127.11.70.193:37315)
0808 05:03:15.867284 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.867286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.867295 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:15.867321 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.867321 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.867337 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.867382 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:15.867547 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.867974 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.869083 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.869257 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.869308 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.869487 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.869511 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.869549 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.869635 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.869655 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:03:15.875160 14669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.872608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:47929 (local address 127.11.70.193:37315)
0808 05:03:15.872647 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.872649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.872763 (+ 114us) server_negotiation.cc:407] Connection header received
0808 05:03:15.872825 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.872826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.872834 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.872877 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:15.873046 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.873470 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.874363 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.874704 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.874769 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.874937 (+ 168us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.874968 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.875027 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.875060 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.875079 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:03:15.875165 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.872525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:37315 (local address 127.11.70.193:47929)
0808 05:03:15.872690 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.872699 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.872778 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.872925 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.872926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.872928 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:15.872983 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.872984 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.873570 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.873571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.874285 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.874287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.874788 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.874789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.874838 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.874851 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.875027 (+ 176us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.875028 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.875057 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.875086 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":84,"threads_started":1}
I20260808 05:03:15.877509 14574 raft_consensus.cc:1261] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Refusing update from remote peer 15cbe593f95a452da1bde3d4898a7859: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:15.877652 14379 raft_consensus.cc:1261] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Refusing update from remote peer 15cbe593f95a452da1bde3d4898a7859: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:15.877866 14723 consensus_queue.cc:1035] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:15.878000 14684 consensus_queue.cc:1035] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:15.889407 13958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:15.889536 13958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:15.890276 13958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05: Sending DeleteTablet for 3 replicas of tablet 88cd9e1b9b994fc6886f395cb0337361
I20260808 05:03:15.890610 14349 tablet_service.cc:1514] Processing DeleteTablet for tablet 88cd9e1b9b994fc6886f395cb0337361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:15 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:50732
I20260808 05:03:15.890619 14142 tablet_service.cc:1514] Processing DeleteTablet for tablet 88cd9e1b9b994fc6886f395cb0337361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:15 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:42100
I20260808 05:03:15.890969 14547 tablet_service.cc:1514] Processing DeleteTablet for tablet 88cd9e1b9b994fc6886f395cb0337361 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:15 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:49656
I20260808 05:03:15.891004 14736 tablet_replica.cc:330] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: stopping tablet replica
I20260808 05:03:15.891244 14739 tablet_replica.cc:330] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: stopping tablet replica
I20260808 05:03:15.891188 13958 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:15.891310 13958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:15.891494 14736 raft_consensus.cc:2229] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:15.891571 14736 raft_consensus.cc:2258] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:15.891762 14737 tablet_replica.cc:330] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: stopping tablet replica
I20260808 05:03:15.891790 14739 raft_consensus.cc:2229] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:15.891993 14739 raft_consensus.cc:2258] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:15.892544 14349 tablet_service.cc:1467] Processing CreateTablet for tablet 6823d1a3059b42489947bc6f4dbc1359 (DEFAULT_TABLE table=test-table [id=8874eb9790db49669860b624e4a7a95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:15.892563 14142 tablet_service.cc:1467] Processing CreateTablet for tablet 6823d1a3059b42489947bc6f4dbc1359 (DEFAULT_TABLE table=test-table [id=8874eb9790db49669860b624e4a7a95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:15.892683 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6823d1a3059b42489947bc6f4dbc1359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.892683 14142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6823d1a3059b42489947bc6f4dbc1359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.892696 14739 ts_tablet_manager.cc:1905] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:15.894145 14677 tablet_bootstrap.cc:492] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: Bootstrap starting.
I20260808 05:03:15.894145 14681 tablet_bootstrap.cc:492] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: Bootstrap starting.
I20260808 05:03:15.894575 14739 ts_tablet_manager.cc:1918] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:15.894596 14677 tablet_bootstrap.cc:654] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.894718 14739 log.cc:1196] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/88cd9e1b9b994fc6886f395cb0337361
I20260808 05:03:15.894795 14681 tablet_bootstrap.cc:654] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.895120 14739 ts_tablet_manager.cc:1939] T 88cd9e1b9b994fc6886f395cb0337361 P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting consensus metadata
I20260808 05:03:15.895149 14547 tablet_service.cc:1467] Processing CreateTablet for tablet 6823d1a3059b42489947bc6f4dbc1359 (DEFAULT_TABLE table=test-table [id=8874eb9790db49669860b624e4a7a95f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:15.895272 14547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6823d1a3059b42489947bc6f4dbc1359. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:15.895586 14681 tablet_bootstrap.cc:492] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: No bootstrap required, opened a new log
I20260808 05:03:15.895632 14681 ts_tablet_manager.cc:1397] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:15.895749 14736 ts_tablet_manager.cc:1905] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:15.895802 14681 raft_consensus.cc:348] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.895866 14681 raft_consensus.cc:374] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.895892 14681 raft_consensus.cc:729] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26d5b81008742909ba1c145ec061b00, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.895939 14681 consensus_queue.cc:260] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.896023 14681 ts_tablet_manager.cc:1428] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:15.896472 14675 tablet_bootstrap.cc:492] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: Bootstrap starting.
I20260808 05:03:15.896858 14675 tablet_bootstrap.cc:654] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:15.897421 14736 ts_tablet_manager.cc:1918] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:15.897500 14736 log.cc:1196] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/88cd9e1b9b994fc6886f395cb0337361
I20260808 05:03:15.897719 14736 ts_tablet_manager.cc:1939] T 88cd9e1b9b994fc6886f395cb0337361 P f26d5b81008742909ba1c145ec061b00: Deleting consensus metadata
I20260808 05:03:15.897890 13938 catalog_manager.cc:4841] TS 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105): tablet 88cd9e1b9b994fc6886f395cb0337361 (table test-table [id=ea6c3cf595ee44328946eac621cea28c]) successfully deleted
I20260808 05:03:15.898113 14737 raft_consensus.cc:2229] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:15.898165 14675 tablet_bootstrap.cc:492] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: No bootstrap required, opened a new log
I20260808 05:03:15.898169 13939 catalog_manager.cc:4841] TS f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867): tablet 88cd9e1b9b994fc6886f395cb0337361 (table test-table [id=ea6c3cf595ee44328946eac621cea28c]) successfully deleted
I20260808 05:03:15.898208 14675 ts_tablet_manager.cc:1397] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:15.898265 14737 raft_consensus.cc:2258] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:15.898339 14675 raft_consensus.cc:348] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.898397 14675 raft_consensus.cc:374] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.898416 14675 raft_consensus.cc:729] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3cc0c1181542a9b4f145e3d13f1f11, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.898479 14675 consensus_queue.cc:260] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.898576 14675 ts_tablet_manager.cc:1428] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.898699 14737 ts_tablet_manager.cc:1905] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:15.900192 14737 ts_tablet_manager.cc:1918] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:15.900252 14737 log.cc:1196] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/88cd9e1b9b994fc6886f395cb0337361
I20260808 05:03:15.900432 14737 ts_tablet_manager.cc:1939] T 88cd9e1b9b994fc6886f395cb0337361 P 15cbe593f95a452da1bde3d4898a7859: Deleting consensus metadata
I20260808 05:03:15.900782 13941 catalog_manager.cc:4841] TS 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193:37315): tablet 88cd9e1b9b994fc6886f395cb0337361 (table test-table [id=ea6c3cf595ee44328946eac621cea28c]) successfully deleted
I20260808 05:03:15.902885 14677 tablet_bootstrap.cc:492] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: No bootstrap required, opened a new log
I20260808 05:03:15.902956 14677 ts_tablet_manager.cc:1397] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.001s
I20260808 05:03:15.903105 14677 raft_consensus.cc:348] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.903162 14677 raft_consensus.cc:374] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:15.903203 14677 raft_consensus.cc:729] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15cbe593f95a452da1bde3d4898a7859, State: Initialized, Role: FOLLOWER
I20260808 05:03:15.903251 14677 consensus_queue.cc:260] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.903347 14677 ts_tablet_manager.cc:1428] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:15.940807 14680 raft_consensus.cc:482] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:15.940929 14680 raft_consensus.cc:504] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.941299 14680 leader_election.cc:288] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193:37315), f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867)
I20260808 05:03:15.944705 14488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.941462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:37315 (local address 127.11.70.195:41405)
0808 05:03:15.941521 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.941533 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.941578 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.941783 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.941784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.941786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:15.941868 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.941869 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.942554 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.942555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.943747 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.943750 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.944422 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.944423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.944519 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.944524 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.944577 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.944622 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 05:03:15.944931 14674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.941722 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:53705 (local address 127.11.70.194:41867)
0808 05:03:15.941771 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.941773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.941780 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:15.941806 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.941806 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.941814 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.941871 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:15.942430 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.942944 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.943891 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.944449 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.944527 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.944535 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.944809 (+ 274us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.944856 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:03:15.945189 14745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.941463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:41867 (local address 127.11.70.195:53705)
0808 05:03:15.941650 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.941660 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.941704 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.941901 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.941902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.941905 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:15.942318 (+ 413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.942321 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.943039 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.943040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.943783 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.943785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.944625 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.944626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.944716 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.944720 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.945063 (+ 343us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.945106 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"mutex_wait_us":71,"thread_start_us":62,"threads_started":1}
I20260808 05:03:15.945396 14669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.941581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:41405 (local address 127.11.70.193:37315)
0808 05:03:15.941628 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.941630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.941639 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:15.941666 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.941667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.941677 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.941741 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:15.941936 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.942453 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.943865 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.944299 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.944372 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.944385 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.945250 (+ 865us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.945303 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:03:15.945531 14378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6823d1a3059b42489947bc6f4dbc1359" candidate_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26d5b81008742909ba1c145ec061b00" is_pre_election: true
I20260808 05:03:15.945643 14378 raft_consensus.cc:2454] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3cc0c1181542a9b4f145e3d13f1f11 in term 0.
I20260808 05:03:15.945772 14172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6823d1a3059b42489947bc6f4dbc1359" candidate_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15cbe593f95a452da1bde3d4898a7859" is_pre_election: true
I20260808 05:03:15.945928 14172 raft_consensus.cc:2454] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f3cc0c1181542a9b4f145e3d13f1f11 in term 0.
I20260808 05:03:15.945919 14477 leader_election.cc:302] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f3cc0c1181542a9b4f145e3d13f1f11, f26d5b81008742909ba1c145ec061b00; no voters:
I20260808 05:03:15.946061 14680 raft_consensus.cc:2781] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:15.946110 14680 raft_consensus.cc:482] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:15.946132 14680 raft_consensus.cc:3037] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.947101 14680 raft_consensus.cc:504] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.947302 14680 leader_election.cc:288] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [CANDIDATE]: Term 1 election: Requested vote from peers 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193:37315), f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867)
I20260808 05:03:15.947479 14172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6823d1a3059b42489947bc6f4dbc1359" candidate_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15cbe593f95a452da1bde3d4898a7859"
I20260808 05:03:15.947502 14378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6823d1a3059b42489947bc6f4dbc1359" candidate_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26d5b81008742909ba1c145ec061b00"
I20260808 05:03:15.947567 14172 raft_consensus.cc:3037] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.947592 14378 raft_consensus.cc:3037] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:15.948268 14378 raft_consensus.cc:2454] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3cc0c1181542a9b4f145e3d13f1f11 in term 1.
I20260808 05:03:15.948385 14172 raft_consensus.cc:2454] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f3cc0c1181542a9b4f145e3d13f1f11 in term 1.
I20260808 05:03:15.948439 14477 leader_election.cc:302] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f3cc0c1181542a9b4f145e3d13f1f11, f26d5b81008742909ba1c145ec061b00; no voters:
I20260808 05:03:15.948537 14680 raft_consensus.cc:2781] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:15.948738 14680 raft_consensus.cc:686] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 LEADER]: Becoming Leader. State: Replica: 5f3cc0c1181542a9b4f145e3d13f1f11, State: Running, Role: LEADER
I20260808 05:03:15.948834 14680 consensus_queue.cc:237] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:15.949654 13958 catalog_manager.cc:5495] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } health_report { overall_health: HEALTHY } } }
I20260808 05:03:15.958806 14668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.955855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49668 (local address 127.11.70.195:36105)
0808 05:03:15.955912 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.955915 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.955924 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:15.955957 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.955958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.955976 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.956067 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:15.956151 (+ 84us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.956867 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.957975 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.958174 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.958230 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.958410 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.958555 (+ 145us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.958611 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.958702 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.958728 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:03:15.963769 14645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.961211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:37315 (local address 127.11.70.195:51823)
0808 05:03:15.961285 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.961296 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.961340 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.961464 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.961464 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.961465 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:15.961509 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.961510 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.962344 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.962344 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.962948 (+ 604us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.962950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.963413 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.963413 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.963462 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.963476 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.963652 (+ 176us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.963653 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.963689 (+ 36us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.963721 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 05:03:15.963792 14669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.961285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:51823 (local address 127.11.70.193:37315)
0808 05:03:15.961325 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.961327 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.961335 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:15.961385 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.961386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.961397 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.961465 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:15.961547 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.962257 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.963033 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.963331 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.963414 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.963555 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.963591 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.963645 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.963692 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.963712 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:15.965979 14378 raft_consensus.cc:1261] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Refusing update from remote peer 5f3cc0c1181542a9b4f145e3d13f1f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:15.966049 14172 raft_consensus.cc:1261] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Refusing update from remote peer 5f3cc0c1181542a9b4f145e3d13f1f11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:15.966245 14746 consensus_queue.cc:1035] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:15.966358 14680 consensus_queue.cc:1035] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:15.974443 14731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.971844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:36105 (local address 127.11.70.193:44045)
0808 05:03:15.971884 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:15.971896 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:15.971942 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:15.972090 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:15.972091 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:15.972092 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:15.972130 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.972132 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.972946 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.972947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.973610 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:15.973613 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.974075 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.974076 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:15.974118 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.974124 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.974301 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.974303 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:03:15.974347 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:03:15.974391 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 05:03:15.974550 14668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:15.971937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:44045 (local address 127.11.70.195:36105)
0808 05:03:15.971974 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:15.971976 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:15.971984 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:15.972006 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:15.972006 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:15.972017 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:15.972075 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:15.972212 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.972859 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.973703 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:15.973983 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:15.974076 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:15.974209 (+ 133us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:15.974243 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:15.974297 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:15.974404 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 05:03:15.974424 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 05:03:15.974929 14717 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 05:03:17.497206 13958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:17.497315 13958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:17.498304 13958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05: Sending DeleteTablet for 3 replicas of tablet 6823d1a3059b42489947bc6f4dbc1359
I20260808 05:03:17.498564 14142 tablet_service.cc:1514] Processing DeleteTablet for tablet 6823d1a3059b42489947bc6f4dbc1359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:17 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:42100
I20260808 05:03:17.498631 14349 tablet_service.cc:1514] Processing DeleteTablet for tablet 6823d1a3059b42489947bc6f4dbc1359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:17 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:50732
I20260808 05:03:17.498703 14547 tablet_service.cc:1514] Processing DeleteTablet for tablet 6823d1a3059b42489947bc6f4dbc1359 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:17 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:49656
I20260808 05:03:17.498853 14790 tablet_replica.cc:330] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: stopping tablet replica
I20260808 05:03:17.498917 14790 raft_consensus.cc:2229] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:17.498952 14790 raft_consensus.cc:2258] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:17.499075 14789 tablet_replica.cc:330] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: stopping tablet replica
I20260808 05:03:17.499145 14789 raft_consensus.cc:2229] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:17.499192 14789 raft_consensus.cc:2258] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:17.499250 14790 ts_tablet_manager.cc:1905] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:17.499456 14789 ts_tablet_manager.cc:1905] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:17.500986 14790 ts_tablet_manager.cc:1918] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:03:17.501070 14790 log.cc:1196] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/6823d1a3059b42489947bc6f4dbc1359
I20260808 05:03:17.501271 14789 ts_tablet_manager.cc:1918] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:03:17.501339 14789 log.cc:1196] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/6823d1a3059b42489947bc6f4dbc1359
I20260808 05:03:17.501336 14790 ts_tablet_manager.cc:1939] T 6823d1a3059b42489947bc6f4dbc1359 P f26d5b81008742909ba1c145ec061b00: Deleting consensus metadata
I20260808 05:03:17.501586 14789 ts_tablet_manager.cc:1939] T 6823d1a3059b42489947bc6f4dbc1359 P 15cbe593f95a452da1bde3d4898a7859: Deleting consensus metadata
I20260808 05:03:17.501665 13939 catalog_manager.cc:4841] TS f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867): tablet 6823d1a3059b42489947bc6f4dbc1359 (table test-table [id=8874eb9790db49669860b624e4a7a95f]) successfully deleted
I20260808 05:03:17.501821 14791 tablet_replica.cc:330] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: stopping tablet replica
I20260808 05:03:17.501895 14791 raft_consensus.cc:2229] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:17.501907 13941 catalog_manager.cc:4841] TS 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193:37315): tablet 6823d1a3059b42489947bc6f4dbc1359 (table test-table [id=8874eb9790db49669860b624e4a7a95f]) successfully deleted
I20260808 05:03:17.502007 14791 raft_consensus.cc:2258] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:17.502262 14791 ts_tablet_manager.cc:1905] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:17.504305 14791 ts_tablet_manager.cc:1918] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:03:17.504379 14791 log.cc:1196] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/6823d1a3059b42489947bc6f4dbc1359
I20260808 05:03:17.504827 14791 ts_tablet_manager.cc:1939] T 6823d1a3059b42489947bc6f4dbc1359 P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting consensus metadata
I20260808 05:03:17.505194 13938 catalog_manager.cc:4841] TS 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105): tablet 6823d1a3059b42489947bc6f4dbc1359 (table test-table [id=8874eb9790db49669860b624e4a7a95f]) successfully deleted
Aug 08 05:03:17 dist-test-slave-7kzw krb5kdc[13893](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165397, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:03:17 dist-test-slave-7kzw krb5kdc[13893](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165397, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:17.531772 14805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.519543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56130 (local address 127.11.70.254:32977)
0808 05:03:17.519709 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:17.519711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:17.519721 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:17.519787 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:17.519788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:17.519800 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:17.519895 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:17.520561 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.521133 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.521903 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.522210 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.522268 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.529098 (+ 6830us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:17.529100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:17.529100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:17.529108 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:17.530582 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:17.530952 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:17.530953 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:17.530953 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:17.531015 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:17.531198 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:17.531199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:17.531199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:17.531325 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:17.531409 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:17.531617 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 05:03:17.531689 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":110,"threads_started":1}
I20260808 05:03:17.533308 13958 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:17.533489 13958 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:17.534983 14349 tablet_service.cc:1467] Processing CreateTablet for tablet 8edf21ade9904d788b9ecedd478cd67c (DEFAULT_TABLE table=test-table [id=fc4a3700b19043e9a48430cdbfd82afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:17.535017 14547 tablet_service.cc:1467] Processing CreateTablet for tablet 8edf21ade9904d788b9ecedd478cd67c (DEFAULT_TABLE table=test-table [id=fc4a3700b19043e9a48430cdbfd82afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:17.535151 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8edf21ade9904d788b9ecedd478cd67c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:17.535197 14547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8edf21ade9904d788b9ecedd478cd67c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:17.536355 14806 tablet_bootstrap.cc:492] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: Bootstrap starting.
I20260808 05:03:17.536474 14142 tablet_service.cc:1467] Processing CreateTablet for tablet 8edf21ade9904d788b9ecedd478cd67c (DEFAULT_TABLE table=test-table [id=fc4a3700b19043e9a48430cdbfd82afb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:17.536530 14807 tablet_bootstrap.cc:492] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: Bootstrap starting.
I20260808 05:03:17.536615 14142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8edf21ade9904d788b9ecedd478cd67c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:17.536810 14806 tablet_bootstrap.cc:654] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:17.536921 14807 tablet_bootstrap.cc:654] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:17.537477 14806 tablet_bootstrap.cc:492] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: No bootstrap required, opened a new log
I20260808 05:03:17.537541 14806 ts_tablet_manager.cc:1397] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:17.537635 14806 raft_consensus.cc:348] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.537691 14806 raft_consensus.cc:374] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:17.537704 14806 raft_consensus.cc:729] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3cc0c1181542a9b4f145e3d13f1f11, State: Initialized, Role: FOLLOWER
I20260808 05:03:17.537768 14806 consensus_queue.cc:260] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.537878 14806 ts_tablet_manager.cc:1428] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:17.537876 14807 tablet_bootstrap.cc:492] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: No bootstrap required, opened a new log
I20260808 05:03:17.537985 14807 ts_tablet_manager.cc:1397] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:17.538146 14807 raft_consensus.cc:348] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.538275 14807 raft_consensus.cc:374] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:17.538322 14807 raft_consensus.cc:729] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26d5b81008742909ba1c145ec061b00, State: Initialized, Role: FOLLOWER
I20260808 05:03:17.538378 14807 consensus_queue.cc:260] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.538594 14812 tablet_bootstrap.cc:492] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: Bootstrap starting.
I20260808 05:03:17.538619 14807 ts_tablet_manager.cc:1428] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:17.538956 14812 tablet_bootstrap.cc:654] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:17.539650 14812 tablet_bootstrap.cc:492] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: No bootstrap required, opened a new log
I20260808 05:03:17.539696 14812 ts_tablet_manager.cc:1397] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:17.539781 14812 raft_consensus.cc:348] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.539834 14812 raft_consensus.cc:374] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:17.539846 14812 raft_consensus.cc:729] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15cbe593f95a452da1bde3d4898a7859, State: Initialized, Role: FOLLOWER
I20260808 05:03:17.539908 14812 consensus_queue.cc:260] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.540012 14812 ts_tablet_manager.cc:1428] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:17.732017 14815 raft_consensus.cc:482] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:17.732126 14815 raft_consensus.cc:504] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.732450 14815 leader_election.cc:288] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193:37315), 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105)
I20260808 05:03:17.735805 14823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.732827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:36171 (local address 127.11.70.195:36105)
0808 05:03:17.732976 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:17.732978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:17.732987 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:17.733022 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:17.733024 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:17.733037 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:17.733115 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:17.733329 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.733940 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.735002 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.735418 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.735479 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.735509 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:17.735675 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 05:03:17.735721 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260808 05:03:17.735829 14822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.732748 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:33331 (local address 127.11.70.193:37315)
0808 05:03:17.732938 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:17.732940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:17.733150 (+ 210us) server_negotiation.cc:407] Connection header received
0808 05:03:17.733184 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:17.733186 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:17.733198 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:17.733270 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:17.733443 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.733934 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.735047 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.735429 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.735525 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.735534 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:17.735703 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 05:03:17.735756 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":116,"threads_started":1}
I20260808 05:03:17.735824 14821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.732648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:36105 (local address 127.11.70.194:36171)
0808 05:03:17.732874 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:17.732886 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:17.732946 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:17.733143 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:17.733144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:17.733147 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:17.733247 (+ 100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:17.733249 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.734051 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.734052 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:17.734906 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:17.734908 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.735512 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.735514 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:17.735593 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.735598 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:03:17.735640 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 05:03:17.735710 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"mutex_wait_us":2,"thread_start_us":135,"threads_started":1}
I20260808 05:03:17.735841 14819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.732648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:37315 (local address 127.11.70.194:33331)
0808 05:03:17.733013 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:17.733024 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:17.733105 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:17.733307 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:17.733308 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:17.733310 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:17.733362 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:17.733364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.734020 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.734020 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:17.734925 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:17.734927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.735552 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.735553 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:17.735598 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.735602 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:17.735674 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 05:03:17.735721 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":339,"mutex_wait_us":3,"thread_start_us":105,"threads_started":1}
I20260808 05:03:17.736125 14571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8edf21ade9904d788b9ecedd478cd67c" candidate_uuid: "f26d5b81008742909ba1c145ec061b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" is_pre_election: true
I20260808 05:03:17.736253 14571 raft_consensus.cc:2454] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26d5b81008742909ba1c145ec061b00 in term 0.
I20260808 05:03:17.736292 14172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8edf21ade9904d788b9ecedd478cd67c" candidate_uuid: "f26d5b81008742909ba1c145ec061b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15cbe593f95a452da1bde3d4898a7859" is_pre_election: true
I20260808 05:03:17.736390 14172 raft_consensus.cc:2454] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f26d5b81008742909ba1c145ec061b00 in term 0.
I20260808 05:03:17.736474 14273 leader_election.cc:302] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f3cc0c1181542a9b4f145e3d13f1f11, f26d5b81008742909ba1c145ec061b00; no voters:
I20260808 05:03:17.736616 14815 raft_consensus.cc:2781] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:17.736677 14815 raft_consensus.cc:482] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:17.736696 14815 raft_consensus.cc:3037] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:17.737371 14815 raft_consensus.cc:504] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.737511 14815 leader_election.cc:288] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [CANDIDATE]: Term 1 election: Requested vote from peers 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193:37315), 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105)
I20260808 05:03:17.737692 14571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8edf21ade9904d788b9ecedd478cd67c" candidate_uuid: "f26d5b81008742909ba1c145ec061b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11"
I20260808 05:03:17.737704 14172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8edf21ade9904d788b9ecedd478cd67c" candidate_uuid: "f26d5b81008742909ba1c145ec061b00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "15cbe593f95a452da1bde3d4898a7859"
I20260808 05:03:17.737772 14571 raft_consensus.cc:3037] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:17.737798 14172 raft_consensus.cc:3037] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:17.738440 14571 raft_consensus.cc:2454] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26d5b81008742909ba1c145ec061b00 in term 1.
I20260808 05:03:17.738440 14172 raft_consensus.cc:2454] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f26d5b81008742909ba1c145ec061b00 in term 1.
I20260808 05:03:17.738658 14273 leader_election.cc:302] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5f3cc0c1181542a9b4f145e3d13f1f11, f26d5b81008742909ba1c145ec061b00; no voters:
I20260808 05:03:17.738745 14815 raft_consensus.cc:2781] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:17.738911 14815 raft_consensus.cc:686] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 1 LEADER]: Becoming Leader. State: Replica: f26d5b81008742909ba1c145ec061b00, State: Running, Role: LEADER
I20260808 05:03:17.738999 14815 consensus_queue.cc:237] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.739769 13958 catalog_manager.cc:5495] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 reported cstate change: term changed from 0 to 1, leader changed from <none> to f26d5b81008742909ba1c145ec061b00 (127.11.70.194). New cstate: current_term: 1 leader_uuid: "f26d5b81008742909ba1c145ec061b00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } health_report { overall_health: UNKNOWN } } }
I20260808 05:03:17.768875 14831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.766497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50748 (local address 127.11.70.194:41867)
0808 05:03:17.766650 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:17.766652 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:17.766659 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:17.766695 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:17.766696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:17.766717 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:17.766794 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:17.766915 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.767469 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.768179 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.768391 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.768442 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.768582 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:17.768689 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:17.768756 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:17.768786 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 05:03:17.768802 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":103,"threads_started":1}
I20260808 05:03:17.773837 14835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.771341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:37315 (local address 127.11.70.194:44013)
0808 05:03:17.771586 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:17.771598 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:17.771675 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:17.771792 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:17.771793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:17.771795 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:17.771852 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:17.771853 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.772483 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.772484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:17.773095 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:17.773097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.773465 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.773466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:17.773523 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.773536 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:17.773697 (+ 161us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:17.773698 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:03:17.773733 (+ 35us) client_negotiation.cc:240] Negotiation successful
0808 05:03:17.773768 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":145,"threads_started":1}
I20260808 05:03:17.773820 14822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.771541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:44013 (local address 127.11.70.193:37315)
0808 05:03:17.771611 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:17.771613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:17.771649 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:03:17.771717 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:17.771717 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:17.771727 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:17.771777 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:17.771908 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.772417 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.773187 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.773372 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.773440 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.773610 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:17.773634 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:17.773672 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:17.773746 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 05:03:17.773764 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:03:17.776052 14172 raft_consensus.cc:1261] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Refusing update from remote peer f26d5b81008742909ba1c145ec061b00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:17.776079 14571 raft_consensus.cc:1261] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Refusing update from remote peer f26d5b81008742909ba1c145ec061b00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:17.776310 14815 consensus_queue.cc:1035] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:17.776490 14824 consensus_queue.cc:1035] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:17.784389 14831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.782007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:56911 (local address 127.11.70.194:41867)
0808 05:03:17.782043 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:17.782045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:17.782238 (+ 193us) server_negotiation.cc:407] Connection header received
0808 05:03:17.782300 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:17.782300 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:17.782311 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:17.782365 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:17.782485 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.782961 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.783726 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.783988 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.784063 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.784197 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:17.784234 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:17.784287 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:17.784322 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 05:03:17.784339 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:03:17.784409 14842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.781951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:41867 (local address 127.11.70.193:56911)
0808 05:03:17.782182 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:17.782193 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:17.782250 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:17.782369 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:17.782370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:17.782371 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:17.782418 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:17.782420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.783045 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.783046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:17.783664 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:17.783666 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.784066 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.784067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:17.784128 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.784133 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:17.784283 (+ 150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:17.784285 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:03:17.784317 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 05:03:17.784352 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":103,"threads_started":1}
I20260808 05:03:17.790926 13956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:17.791065 13956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:17.791827 13956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05: Sending DeleteTablet for 3 replicas of tablet 8edf21ade9904d788b9ecedd478cd67c
I20260808 05:03:17.792104 14349 tablet_service.cc:1514] Processing DeleteTablet for tablet 8edf21ade9904d788b9ecedd478cd67c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:17 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:50732
I20260808 05:03:17.792140 14547 tablet_service.cc:1514] Processing DeleteTablet for tablet 8edf21ade9904d788b9ecedd478cd67c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:17 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:49656
I20260808 05:03:17.792199 14142 tablet_service.cc:1514] Processing DeleteTablet for tablet 8edf21ade9904d788b9ecedd478cd67c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:17 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:42100
I20260808 05:03:17.792300 14789 tablet_replica.cc:330] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: stopping tablet replica
I20260808 05:03:17.792308 14790 tablet_replica.cc:330] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: stopping tablet replica
I20260808 05:03:17.792361 14789 raft_consensus.cc:2229] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:17.792361 14790 raft_consensus.cc:2229] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:17.792399 14789 raft_consensus.cc:2258] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:17.792460 14790 raft_consensus.cc:2258] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:17.792572 14791 tablet_replica.cc:330] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: stopping tablet replica
I20260808 05:03:17.792641 14791 raft_consensus.cc:2229] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:17.792681 14791 raft_consensus.cc:2258] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:17.792745 14789 ts_tablet_manager.cc:1905] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:17.792949 14790 ts_tablet_manager.cc:1905] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:17.793033 14791 ts_tablet_manager.cc:1905] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:17.794435 14789 ts_tablet_manager.cc:1918] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:17.794518 14789 log.cc:1196] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/8edf21ade9904d788b9ecedd478cd67c
I20260808 05:03:17.794435 14790 ts_tablet_manager.cc:1918] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:17.794623 14790 log.cc:1196] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/8edf21ade9904d788b9ecedd478cd67c
I20260808 05:03:17.794730 14791 ts_tablet_manager.cc:1918] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:17.794762 14789 ts_tablet_manager.cc:1939] T 8edf21ade9904d788b9ecedd478cd67c P 15cbe593f95a452da1bde3d4898a7859: Deleting consensus metadata
I20260808 05:03:17.794787 14791 log.cc:1196] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/8edf21ade9904d788b9ecedd478cd67c
I20260808 05:03:17.794835 14790 ts_tablet_manager.cc:1939] T 8edf21ade9904d788b9ecedd478cd67c P f26d5b81008742909ba1c145ec061b00: Deleting consensus metadata
I20260808 05:03:17.795009 14791 ts_tablet_manager.cc:1939] T 8edf21ade9904d788b9ecedd478cd67c P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting consensus metadata
I20260808 05:03:17.795230 13941 catalog_manager.cc:4841] TS 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193:37315): tablet 8edf21ade9904d788b9ecedd478cd67c (table test-table [id=fc4a3700b19043e9a48430cdbfd82afb]) successfully deleted
I20260808 05:03:17.795308 13938 catalog_manager.cc:4841] TS 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105): tablet 8edf21ade9904d788b9ecedd478cd67c (table test-table [id=fc4a3700b19043e9a48430cdbfd82afb]) successfully deleted
I20260808 05:03:17.795341 13939 catalog_manager.cc:4841] TS f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867): tablet 8edf21ade9904d788b9ecedd478cd67c (table test-table [id=fc4a3700b19043e9a48430cdbfd82afb]) successfully deleted
I20260808 05:03:17.795352 13956 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56130:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:17.795545 13956 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:17.796749 14142 tablet_service.cc:1467] Processing CreateTablet for tablet a356324fd00649a585ba7303890b3810 (DEFAULT_TABLE table=test-table [id=bed9b845433442c6bd5e30a6ce6dd33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:17.796855 14349 tablet_service.cc:1467] Processing CreateTablet for tablet a356324fd00649a585ba7303890b3810 (DEFAULT_TABLE table=test-table [id=bed9b845433442c6bd5e30a6ce6dd33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:17.796888 14142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a356324fd00649a585ba7303890b3810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:17.796921 14547 tablet_service.cc:1467] Processing CreateTablet for tablet a356324fd00649a585ba7303890b3810 (DEFAULT_TABLE table=test-table [id=bed9b845433442c6bd5e30a6ce6dd33a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:17.796974 14349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a356324fd00649a585ba7303890b3810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:17.797024 14547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a356324fd00649a585ba7303890b3810. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:17.798264 14806 tablet_bootstrap.cc:492] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: Bootstrap starting.
I20260808 05:03:17.798296 14807 tablet_bootstrap.cc:492] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: Bootstrap starting.
I20260808 05:03:17.798622 14806 tablet_bootstrap.cc:654] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:17.798767 14807 tablet_bootstrap.cc:654] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:17.798940 14812 tablet_bootstrap.cc:492] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859: Bootstrap starting.
I20260808 05:03:17.799252 14812 tablet_bootstrap.cc:654] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:17.799667 14807 tablet_bootstrap.cc:492] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: No bootstrap required, opened a new log
I20260808 05:03:17.799698 14806 tablet_bootstrap.cc:492] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: No bootstrap required, opened a new log
I20260808 05:03:17.799724 14807 ts_tablet_manager.cc:1397] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:17.799744 14806 ts_tablet_manager.cc:1397] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:17.799857 14806 raft_consensus.cc:348] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.799897 14807 raft_consensus.cc:348] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.799948 14806 raft_consensus.cc:374] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:17.799962 14807 raft_consensus.cc:374] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:17.799980 14806 raft_consensus.cc:729] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f3cc0c1181542a9b4f145e3d13f1f11, State: Initialized, Role: FOLLOWER
I20260808 05:03:17.799985 14807 raft_consensus.cc:729] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26d5b81008742909ba1c145ec061b00, State: Initialized, Role: FOLLOWER
I20260808 05:03:17.800028 14807 consensus_queue.cc:260] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.800024 14806 consensus_queue.cc:260] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.800127 14806 ts_tablet_manager.cc:1428] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:17.800145 14807 ts_tablet_manager.cc:1428] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:17.800412 14812 tablet_bootstrap.cc:492] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859: No bootstrap required, opened a new log
I20260808 05:03:17.800462 14812 ts_tablet_manager.cc:1397] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:17.800581 14812 raft_consensus.cc:348] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.800649 14812 raft_consensus.cc:374] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:17.800671 14812 raft_consensus.cc:729] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15cbe593f95a452da1bde3d4898a7859, State: Initialized, Role: FOLLOWER
I20260808 05:03:17.800714 14812 consensus_queue.cc:260] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.800799 14812 ts_tablet_manager.cc:1428] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:17.890591 14767 raft_consensus.cc:482] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:17.890725 14767 raft_consensus.cc:504] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.890975 14767 leader_election.cc:288] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867), 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105)
I20260808 05:03:17.891233 14571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a356324fd00649a585ba7303890b3810" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" is_pre_election: true
I20260808 05:03:17.891251 14378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a356324fd00649a585ba7303890b3810" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26d5b81008742909ba1c145ec061b00" is_pre_election: true
I20260808 05:03:17.891353 14571 raft_consensus.cc:2454] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 0.
I20260808 05:03:17.891353 14378 raft_consensus.cc:2454] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 0.
I20260808 05:03:17.891542 14079 leader_election.cc:302] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15cbe593f95a452da1bde3d4898a7859, 5f3cc0c1181542a9b4f145e3d13f1f11; no voters:
I20260808 05:03:17.891660 14767 raft_consensus.cc:2781] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:17.891716 14767 raft_consensus.cc:482] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:17.891757 14767 raft_consensus.cc:3037] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:17.892616 14767 raft_consensus.cc:504] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.892808 14767 leader_election.cc:288] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 election: Requested vote from peers f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867), 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105)
I20260808 05:03:17.893018 14378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a356324fd00649a585ba7303890b3810" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26d5b81008742909ba1c145ec061b00"
I20260808 05:03:17.893015 14571 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a356324fd00649a585ba7303890b3810" candidate_uuid: "15cbe593f95a452da1bde3d4898a7859" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11"
I20260808 05:03:17.893105 14571 raft_consensus.cc:3037] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:17.893103 14378 raft_consensus.cc:3037] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:17.893980 14378 raft_consensus.cc:2454] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 1.
I20260808 05:03:17.893981 14571 raft_consensus.cc:2454] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 15cbe593f95a452da1bde3d4898a7859 in term 1.
I20260808 05:03:17.894176 14080 leader_election.cc:302] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 15cbe593f95a452da1bde3d4898a7859, f26d5b81008742909ba1c145ec061b00; no voters:
I20260808 05:03:17.894279 14767 raft_consensus.cc:2781] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:17.894335 14767 raft_consensus.cc:686] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 1 LEADER]: Becoming Leader. State: Replica: 15cbe593f95a452da1bde3d4898a7859, State: Running, Role: LEADER
I20260808 05:03:17.894397 14767 consensus_queue.cc:237] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } }
I20260808 05:03:17.895229 13955 catalog_manager.cc:5495] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 reported cstate change: term changed from 0 to 1, leader changed from <none> to 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193). New cstate: current_term: 1 leader_uuid: "15cbe593f95a452da1bde3d4898a7859" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15cbe593f95a452da1bde3d4898a7859" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 37315 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 } health_report { overall_health: UNKNOWN } } }
I20260808 05:03:17.922654 14822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:17.920235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42140 (local address 127.11.70.193:37315)
0808 05:03:17.920289 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:17.920291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:17.920298 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:17.920317 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:17.920318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:17.920328 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:17.920380 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:17.920580 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.921199 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.921950 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:17.922136 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:17.922197 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:17.922369 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:17.922396 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:17.922436 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:17.922574 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 05:03:17.922593 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:03:17.925019 14378 raft_consensus.cc:1261] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Refusing update from remote peer 15cbe593f95a452da1bde3d4898a7859: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:17.925019 14571 raft_consensus.cc:1261] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Refusing update from remote peer 15cbe593f95a452da1bde3d4898a7859: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:17.925292 14767 consensus_queue.cc:1035] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5f3cc0c1181542a9b4f145e3d13f1f11" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 36105 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:17.925421 14761 consensus_queue.cc:1035] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26d5b81008742909ba1c145ec061b00" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 41867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 05:03:17.930150 14757 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 05:03:19.450169 13956 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:19.450276 13956 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:56130:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:19.451188 13956 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5d5eba6beda74fa3ad10a4d6ab690d05: Sending DeleteTablet for 3 replicas of tablet a356324fd00649a585ba7303890b3810
I20260808 05:03:19.451413 14142 tablet_service.cc:1514] Processing DeleteTablet for tablet a356324fd00649a585ba7303890b3810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:19 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:42100
I20260808 05:03:19.451476 14547 tablet_service.cc:1514] Processing DeleteTablet for tablet a356324fd00649a585ba7303890b3810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:19 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:49656
I20260808 05:03:19.451607 14349 tablet_service.cc:1514] Processing DeleteTablet for tablet a356324fd00649a585ba7303890b3810 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:19 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:50732
I20260808 05:03:19.451623 14881 tablet_replica.cc:330] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859: stopping tablet replica
I20260808 05:03:19.451690 14881 raft_consensus.cc:2229] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:19.451689 14882 tablet_replica.cc:330] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: stopping tablet replica
I20260808 05:03:19.451741 14881 raft_consensus.cc:2258] T a356324fd00649a585ba7303890b3810 P 15cbe593f95a452da1bde3d4898a7859 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:19.451753 14882 raft_consensus.cc:2229] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:19.451797 14882 raft_consensus.cc:2258] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:19.451828 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 14059
I20260808 05:03:19.457800 14882 ts_tablet_manager.cc:1905] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:19.459283 14882 ts_tablet_manager.cc:1918] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:03:19.459331 14882 log.cc:1196] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/a356324fd00649a585ba7303890b3810
I20260808 05:03:19.459497 14882 ts_tablet_manager.cc:1939] T a356324fd00649a585ba7303890b3810 P 5f3cc0c1181542a9b4f145e3d13f1f11: Deleting consensus metadata
I20260808 05:03:19.459921 13938 catalog_manager.cc:4841] TS 5f3cc0c1181542a9b4f145e3d13f1f11 (127.11.70.195:36105): tablet a356324fd00649a585ba7303890b3810 (table test-table [id=bed9b845433442c6bd5e30a6ce6dd33a]) successfully deleted
I20260808 05:03:19.462678 14883 tablet_replica.cc:330] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: stopping tablet replica
I20260808 05:03:19.462772 14883 raft_consensus.cc:2229] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:19.462824 14883 raft_consensus.cc:2258] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:19.463085 14883 ts_tablet_manager.cc:1905] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:19.464344 14883 ts_tablet_manager.cc:1918] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:03:19.464426 14883 log.cc:1196] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/a356324fd00649a585ba7303890b3810
I20260808 05:03:19.464639 14883 ts_tablet_manager.cc:1939] T a356324fd00649a585ba7303890b3810 P f26d5b81008742909ba1c145ec061b00: Deleting consensus metadata
I20260808 05:03:19.464968 13939 catalog_manager.cc:4841] TS f26d5b81008742909ba1c145ec061b00 (127.11.70.194:41867): tablet a356324fd00649a585ba7303890b3810 (table test-table [id=bed9b845433442c6bd5e30a6ce6dd33a]) successfully deleted
W20260808 05:03:19.467599 13941 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:37315 (error 108)
I20260808 05:03:19.467839 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 14253
I20260808 05:03:19.472622 14885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:19.468003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:37315 (local address 127.0.0.1:42142)
0808 05:03:19.472504 (+ 4501us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:19.472568 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:37315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4470,"thread_start_us":58,"threads_started":1}
W20260808 05:03:19.472862 13941 catalog_manager.cc:4584] TS 15cbe593f95a452da1bde3d4898a7859 (127.11.70.193:37315): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet a356324fd00649a585ba7303890b3810: Network error: Client connection negotiation failed: client connection to 127.11.70.193:37315: connect: Connection refused (error 111)
I20260808 05:03:19.478686 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 14453
I20260808 05:03:19.488793 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 13911
2026-08-08T05:03:19Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5881 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:19 dist-test-slave-7kzw krb5kdc[14889](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:19 dist-test-slave-7kzw krb5kdc[14889](info): set up 2 sockets
Aug 08 05:03:19 dist-test-slave-7kzw krb5kdc[14889](info): commencing operation
krb5kdc: starting...
W20260808 05:03:20.722262 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:20 dist-test-slave-7kzw krb5kdc[14889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:20.845424 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:41303
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:41303
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:20.929039 14909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:20.929286 14909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:20.929324 14909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:20.930603 14909 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:20.930676 14909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:20.930701 14909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:20.930722 14909 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:20.930749 14909 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:20.932250 14909 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:41303
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:41303
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:20.932535 14909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:20.932782 14909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:20.937841 14922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:20.938009 14916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:20.938015 14909 server_base.cc:1034] running on GCE node
W20260808 05:03:20.937928 14917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:20.938504 14909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:20.938853 14909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:20.940019 14909 hybrid_clock.cc:648] HybridClock initialized: now 1786165400940008 us; error 44 us; skew 500 ppm
Aug 08 05:03:20 dist-test-slave-7kzw krb5kdc[14889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165400, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:20.942747 14909 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:20.943192 14909 webserver.cc:460] Webserver started at http://127.11.70.254:43653/ using document root <none> and password file <none>
I20260808 05:03:20.943455 14909 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:20.943531 14909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:20.943684 14909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:20.944782 14909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "4b0066435ae34bc7909df78e3fbeb11e"
format_stamp: "Formatted at 2026-08-08 05:03:20 on dist-test-slave-7kzw"
server_key: "cc9428ce20ac9b9ae7502e21c5af2240"
server_key_iv: "b656385a2bfcdb4eb093fad41cca037e"
server_key_version: "encryptionkey@0"
I20260808 05:03:20.945153 14909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "4b0066435ae34bc7909df78e3fbeb11e"
format_stamp: "Formatted at 2026-08-08 05:03:20 on dist-test-slave-7kzw"
server_key: "cc9428ce20ac9b9ae7502e21c5af2240"
server_key_iv: "b656385a2bfcdb4eb093fad41cca037e"
server_key_version: "encryptionkey@0"
I20260808 05:03:20.946606 14909 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:20.947463 14930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:20.947683 14909 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:20.947810 14909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "4b0066435ae34bc7909df78e3fbeb11e"
format_stamp: "Formatted at 2026-08-08 05:03:20 on dist-test-slave-7kzw"
server_key: "cc9428ce20ac9b9ae7502e21c5af2240"
server_key_iv: "b656385a2bfcdb4eb093fad41cca037e"
server_key_version: "encryptionkey@0"
I20260808 05:03:20.947890 14909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:20.963780 14909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:20.966164 14909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:20.966341 14909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:20.970513 14909 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:41303
I20260808 05:03:20.970575 15006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:41303 every 8 connection(s)
I20260808 05:03:20.970959 14909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:20.971853 15007 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:20.974138 15007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e: Bootstrap starting.
I20260808 05:03:20.974771 15007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:20.975078 15007 log.cc:824] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:20.975790 15007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e: No bootstrap required, opened a new log
I20260808 05:03:20.977391 15007 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0066435ae34bc7909df78e3fbeb11e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 41303 } }
I20260808 05:03:20.977535 15007 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:20.977558 15007 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b0066435ae34bc7909df78e3fbeb11e, State: Initialized, Role: FOLLOWER
I20260808 05:03:20.977766 15007 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0066435ae34bc7909df78e3fbeb11e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 41303 } }
I20260808 05:03:20.977880 15007 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:20.977937 15007 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:20.977991 15007 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:20.978571 15007 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0066435ae34bc7909df78e3fbeb11e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 41303 } }
I20260808 05:03:20.978684 15007 leader_election.cc:302] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b0066435ae34bc7909df78e3fbeb11e; no voters:
I20260808 05:03:20.978869 15007 leader_election.cc:288] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:20.978895 15011 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:20.979080 15011 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [term 1 LEADER]: Becoming Leader. State: Replica: 4b0066435ae34bc7909df78e3fbeb11e, State: Running, Role: LEADER
I20260808 05:03:20.979159 15007 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:20.979203 15011 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0066435ae34bc7909df78e3fbeb11e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 41303 } }
I20260808 05:03:20.979799 15013 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b0066435ae34bc7909df78e3fbeb11e. Latest consensus state: current_term: 1 leader_uuid: "4b0066435ae34bc7909df78e3fbeb11e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0066435ae34bc7909df78e3fbeb11e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 41303 } } }
I20260808 05:03:20.979897 15013 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:20.980110 15012 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b0066435ae34bc7909df78e3fbeb11e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b0066435ae34bc7909df78e3fbeb11e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 41303 } } }
I20260808 05:03:20.980257 15012 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:20.980271 15023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:20.980566 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 14909
I20260808 05:03:20.980665 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:20.980868 11547 external_mini_cluster.cc:1428] Setting key e6be02e40a86b1b0cd7a040bef85086a
I20260808 05:03:20.980868 15023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:20.982580 15023 catalog_manager.cc:1347] Generated new cluster ID: 55f8b0ed6c6d43499c2e4172a18ad2f9
I20260808 05:03:20.982635 15023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:03:20 dist-test-slave-7kzw krb5kdc[14889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165400, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:20.993119 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:20.981526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40976 (local address 127.11.70.254:41303)
0808 05:03:20.981983 (+ 457us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:20.981993 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:20.982039 (+ 46us) server_negotiation.cc:407] Connection header received
0808 05:03:20.982183 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:20.982192 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:20.982261 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:20.982406 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:20.983265 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:20.984649 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:20.985720 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:20.986295 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:20.986395 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:20.989398 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:20.989403 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:20.989403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:20.989418 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:20.991446 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:20.991851 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:20.991854 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:20.991855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:20.991972 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:20.992177 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:20.992178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:20.992179 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:20.992488 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:20.992650 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:20.992735 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 05:03:20.992873 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":75,"threads_started":1}
I20260808 05:03:20.997054 15023 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:20.997643 15023 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:21.000236 15023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b0066435ae34bc7909df78e3fbeb11e: Generated new TSK 0
I20260808 05:03:21.000417 15023 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:21.029965 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:41303
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:21.118489 15042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:21.118705 15042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:21.118727 15042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:21.119892 15042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:21.119935 15042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:21.119987 15042 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:21.121444 15042 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:41303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:21.121668 15042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:21.121899 15042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:21.127194 15051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:21.127363 15042 server_base.cc:1034] running on GCE node
W20260808 05:03:21.127285 15048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:21.127303 15049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:21.127768 15042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:21.128062 15042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:21.129233 15042 hybrid_clock.cc:648] HybridClock initialized: now 1786165401129229 us; error 37 us; skew 500 ppm
Aug 08 05:03:21 dist-test-slave-7kzw krb5kdc[14889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:21.132381 15042 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:21.132812 15042 webserver.cc:460] Webserver started at http://127.11.70.193:42843/ using document root <none> and password file <none>
I20260808 05:03:21.133047 15042 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:21.133116 15042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:21.133279 15042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:21.134366 15042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "6c6493e8b9fa43d3963d4fa7ebfa9d02"
format_stamp: "Formatted at 2026-08-08 05:03:21 on dist-test-slave-7kzw"
server_key: "7df8b4564bc036784a5fd7a7326a942a"
server_key_iv: "67cc28f1b946f208ec247c888335315d"
server_key_version: "encryptionkey@0"
I20260808 05:03:21.134815 15042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "6c6493e8b9fa43d3963d4fa7ebfa9d02"
format_stamp: "Formatted at 2026-08-08 05:03:21 on dist-test-slave-7kzw"
server_key: "7df8b4564bc036784a5fd7a7326a942a"
server_key_iv: "67cc28f1b946f208ec247c888335315d"
server_key_version: "encryptionkey@0"
I20260808 05:03:21.136137 15042 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:21.136871 15061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.137046 15042 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:21.137148 15042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "6c6493e8b9fa43d3963d4fa7ebfa9d02"
format_stamp: "Formatted at 2026-08-08 05:03:21 on dist-test-slave-7kzw"
server_key: "7df8b4564bc036784a5fd7a7326a942a"
server_key_iv: "67cc28f1b946f208ec247c888335315d"
server_key_version: "encryptionkey@0"
I20260808 05:03:21.137243 15042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:21.153537 15042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:21.155424 15042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:21.155591 15042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:21.155826 15042 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:21.156145 15042 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:21.156201 15042 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.156252 15042 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:21.156283 15042 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.162277 15042 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:40961
I20260808 05:03:21.162379 15233 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:40961 every 8 connection(s)
I20260808 05:03:21.162698 15042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:21.167822 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 15042
I20260808 05:03:21.167941 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:21.168124 11547 external_mini_cluster.cc:1428] Setting key 57d29e7c61ea1c526075fd8d1840be00
Aug 08 05:03:21 dist-test-slave-7kzw krb5kdc[14889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:21.172524 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:21.163490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:40739 (local address 127.11.70.254:41303)
0808 05:03:21.163558 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:21.163560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:21.163767 (+ 207us) server_negotiation.cc:407] Connection header received
0808 05:03:21.164225 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:21.164226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:21.164240 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:21.164291 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:21.165194 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.165752 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.166811 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.167007 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.167061 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:21.169440 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:21.169441 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:21.169442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:21.169448 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:21.171096 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:21.171502 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:21.171503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:21.171504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:21.171575 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:21.171810 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:21.171811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:21.171812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:21.171963 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:21.172038 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:21.172372 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 05:03:21.172456 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:03:21.172825 15237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:21.163428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:41303 (local address 127.11.70.193:40739)
0808 05:03:21.163634 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:21.163673 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:21.164137 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:21.164343 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:21.164346 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:21.164921 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:21.165115 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:21.165119 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.165846 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.165847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:21.166732 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:21.166735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.167081 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.167082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:21.167184 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:21.167691 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:21.167699 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:21.169349 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:21.171194 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:21.171201 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:21.171202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:21.171428 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:21.171645 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:21.171645 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:21.171646 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:21.171745 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:21.172031 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:21.172036 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:21.172225 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 05:03:21.172340 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 05:03:21.172521 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":69,"threads_started":1}
I20260808 05:03:21.173334 15234 heartbeater.cc:347] Connected to a master server at 127.11.70.254:41303
I20260808 05:03:21.173447 15234 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:21.173626 15234 heartbeater.cc:511] Master 127.11.70.254:41303 requested a full tablet report, sending...
I20260808 05:03:21.174208 14949 ts_manager.cc:194] Registered new tserver with Master: 6c6493e8b9fa43d3963d4fa7ebfa9d02 (127.11.70.193:40961)
I20260808 05:03:21.174918 14949 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:40739
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:21.194981 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:41303
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:21.278270 15241 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:21.278527 15241 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:21.278569 15241 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:21.279882 15241 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:21.279946 15241 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:21.279991 15241 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:21.281472 15241 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:41303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15241
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:21.281736 15241 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:21.281965 15241 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:21.287127 15250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:21.287129 15248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:21.287115 15247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:21.287508 15241 server_base.cc:1034] running on GCE node
I20260808 05:03:21.287736 15241 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:21.287984 15241 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:21.289149 15241 hybrid_clock.cc:648] HybridClock initialized: now 1786165401289144 us; error 37 us; skew 500 ppm
Aug 08 05:03:21 dist-test-slave-7kzw krb5kdc[14889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:21.291627 15241 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:21.292109 15241 webserver.cc:460] Webserver started at http://127.11.70.194:39779/ using document root <none> and password file <none>
I20260808 05:03:21.292346 15241 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:21.292416 15241 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:21.292570 15241 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:21.293633 15241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "112363a6e0e14cf69e8fd5d13b170929"
format_stamp: "Formatted at 2026-08-08 05:03:21 on dist-test-slave-7kzw"
server_key: "8c85c8a71f422e2cc354372b1cb9b0a4"
server_key_iv: "43e395638b726a1babb0c93ee9da3274"
server_key_version: "encryptionkey@0"
I20260808 05:03:21.294010 15241 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "112363a6e0e14cf69e8fd5d13b170929"
format_stamp: "Formatted at 2026-08-08 05:03:21 on dist-test-slave-7kzw"
server_key: "8c85c8a71f422e2cc354372b1cb9b0a4"
server_key_iv: "43e395638b726a1babb0c93ee9da3274"
server_key_version: "encryptionkey@0"
I20260808 05:03:21.295423 15241 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:21.296159 15263 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.296329 15241 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.296437 15241 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "112363a6e0e14cf69e8fd5d13b170929"
format_stamp: "Formatted at 2026-08-08 05:03:21 on dist-test-slave-7kzw"
server_key: "8c85c8a71f422e2cc354372b1cb9b0a4"
server_key_iv: "43e395638b726a1babb0c93ee9da3274"
server_key_version: "encryptionkey@0"
I20260808 05:03:21.296514 15241 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:21.307057 15241 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:21.308841 15241 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:21.309005 15241 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:21.309232 15241 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:21.309545 15241 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:21.309602 15241 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.309644 15241 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:21.309670 15241 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.315943 15241 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:45057
I20260808 05:03:21.316000 15429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:45057 every 8 connection(s)
I20260808 05:03:21.316303 15241 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:21.319980 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 15241
I20260808 05:03:21.320067 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:21.320258 11547 external_mini_cluster.cc:1428] Setting key a6afe28d35680406e97e1d0136939a8e
Aug 08 05:03:21 dist-test-slave-7kzw krb5kdc[14889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:21.325897 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:21.317028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:39395 (local address 127.11.70.254:41303)
0808 05:03:21.317093 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:21.317095 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:21.317273 (+ 178us) server_negotiation.cc:407] Connection header received
0808 05:03:21.317740 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:21.317741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:21.317751 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:21.317806 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:21.318775 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.319275 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.320275 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.320556 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.320629 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:21.322897 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:21.322898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:21.322898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:21.322906 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:21.324399 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:21.324927 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:21.324928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:21.324929 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:21.324989 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:21.325282 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:21.325282 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:21.325282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:21.325383 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:21.325435 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:21.325760 (+ 325us) server_negotiation.cc:299] Negotiation successful
0808 05:03:21.325832 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:03:21.326225 15435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:21.316990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:41303 (local address 127.11.70.194:39395)
0808 05:03:21.317141 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:21.317183 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:21.317654 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:21.317855 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:21.317858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:21.318410 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:21.318686 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:21.318691 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.319357 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.319358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:21.320181 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:21.320184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.320667 (+ 483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.320669 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:21.320813 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:21.321418 (+ 605us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:21.321427 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:21.322797 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:21.324506 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:21.324514 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:21.324516 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:21.324847 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:21.325063 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:21.325064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:21.325064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:21.325214 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:21.325448 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:21.325454 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:21.325618 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 05:03:21.325741 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 05:03:21.325927 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":82,"threads_started":1}
I20260808 05:03:21.326797 15430 heartbeater.cc:347] Connected to a master server at 127.11.70.254:41303
I20260808 05:03:21.326902 15430 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:21.327101 15430 heartbeater.cc:511] Master 127.11.70.254:41303 requested a full tablet report, sending...
I20260808 05:03:21.327499 14949 ts_manager.cc:194] Registered new tserver with Master: 112363a6e0e14cf69e8fd5d13b170929 (127.11.70.194:45057)
I20260808 05:03:21.328063 14949 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:39395
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:21.348649 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:41303
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44811
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:21.431635 15438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:21.431864 15438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:21.431905 15438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:21.433058 15438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:21.433118 15438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:21.433163 15438 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:21.434636 15438 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44811
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:41303
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:21.434886 15438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:21.435107 15438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:21.440145 15451 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:21.440255 15447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:21.440145 15446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:21.440443 15438 server_base.cc:1034] running on GCE node
I20260808 05:03:21.440668 15438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:21.440908 15438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:21.442099 15438 hybrid_clock.cc:648] HybridClock initialized: now 1786165401442083 us; error 29 us; skew 500 ppm
Aug 08 05:03:21 dist-test-slave-7kzw krb5kdc[14889](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:21.444607 15438 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:21.445075 15438 webserver.cc:460] Webserver started at http://127.11.70.195:42121/ using document root <none> and password file <none>
I20260808 05:03:21.445298 15438 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:21.445343 15438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:21.445488 15438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:21.446584 15438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "00e156d01cea4af687873c0eed55f392"
format_stamp: "Formatted at 2026-08-08 05:03:21 on dist-test-slave-7kzw"
server_key: "9758c6d4786176bce23cac8ca2c9573b"
server_key_iv: "c4877128ff9bbed931d515ce4136f447"
server_key_version: "encryptionkey@0"
I20260808 05:03:21.446951 15438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "00e156d01cea4af687873c0eed55f392"
format_stamp: "Formatted at 2026-08-08 05:03:21 on dist-test-slave-7kzw"
server_key: "9758c6d4786176bce23cac8ca2c9573b"
server_key_iv: "c4877128ff9bbed931d515ce4136f447"
server_key_version: "encryptionkey@0"
I20260808 05:03:21.448413 15438 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:21.449121 15462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.449297 15438 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:21.449370 15438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "00e156d01cea4af687873c0eed55f392"
format_stamp: "Formatted at 2026-08-08 05:03:21 on dist-test-slave-7kzw"
server_key: "9758c6d4786176bce23cac8ca2c9573b"
server_key_iv: "c4877128ff9bbed931d515ce4136f447"
server_key_version: "encryptionkey@0"
I20260808 05:03:21.449457 15438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:21.459801 15438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:21.461535 15438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:21.461687 15438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:21.461912 15438 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:21.462203 15438 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:21.462240 15438 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.462262 15438 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:21.462308 15438 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:21.468432 15438 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:42013
I20260808 05:03:21.468484 15639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:42013 every 8 connection(s)
I20260808 05:03:21.468782 15438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:03:21.473590 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 15438
I20260808 05:03:21.473680 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:21.473875 11547 external_mini_cluster.cc:1428] Setting key bd72ecfe524b5c96c81686a688e37d11
Aug 08 05:03:21 dist-test-slave-7kzw krb5kdc[14889](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165401, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:21.477744 15035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:21.469490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:46195 (local address 127.11.70.254:41303)
0808 05:03:21.469571 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:21.469574 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:21.469739 (+ 165us) server_negotiation.cc:407] Connection header received
0808 05:03:21.470187 (+ 448us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:21.470188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:21.470197 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:21.470247 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:21.471162 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.471654 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.472592 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.472775 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.472824 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:21.475380 (+ 2556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:21.475381 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:21.475382 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:21.475388 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:21.476592 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:21.476956 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:21.476957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:21.476957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:21.477007 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:21.477225 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:21.477225 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:21.477225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:21.477323 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:21.477373 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:21.477611 (+ 238us) server_negotiation.cc:299] Negotiation successful
0808 05:03:21.477673 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:03:21.477928 15642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:21.469436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:41303 (local address 127.11.70.195:46195)
0808 05:03:21.469618 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:21.469652 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:21.470108 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:21.470304 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:21.470307 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:21.470890 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:21.471078 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:21.471082 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.471737 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.471738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:21.472515 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:21.472516 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:21.472851 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:21.472852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:21.472950 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:21.473511 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:21.473519 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:21.475296 (+ 1777us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:21.476663 (+ 1367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:21.476669 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:21.476671 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:21.476891 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:21.477065 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:21.477066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:21.477066 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:21.477166 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:21.477378 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:21.477383 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:21.477498 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 05:03:21.477579 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 05:03:21.477693 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":106,"threads_started":1}
I20260808 05:03:21.478394 15640 heartbeater.cc:347] Connected to a master server at 127.11.70.254:41303
I20260808 05:03:21.478538 15640 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:21.478790 15640 heartbeater.cc:511] Master 127.11.70.254:41303 requested a full tablet report, sending...
I20260808 05:03:21.479167 14949 ts_manager.cc:194] Registered new tserver with Master: 00e156d01cea4af687873c0eed55f392 (127.11.70.195:42013)
I20260808 05:03:21.479578 14949 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:46195
I20260808 05:03:21.485986 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 05:03:21.503085 15035 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:21.502035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40984 (local address 127.11.70.254:41303)
0808 05:03:21.502117 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:21.502119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:21.502212 (+ 93us) server_negotiation.cc:407] Connection header received
0808 05:03:21.502332 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:21.502333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:21.502347 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:21.502413 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:21.503025 (+ 612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40984: BlockingRecv error: recv got EOF from 127.0.0.1:40984 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:03:21.504175 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 15042
I20260808 05:03:21.518090 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 15241
I20260808 05:03:21.526191 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 15438
I20260808 05:03:21.537200 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 14909
2026-08-08T05:03:21Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2048 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:21 dist-test-slave-7kzw krb5kdc[15658](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:21 dist-test-slave-7kzw krb5kdc[15658](info): set up 2 sockets
Aug 08 05:03:21 dist-test-slave-7kzw krb5kdc[15658](info): commencing operation
krb5kdc: starting...
W20260808 05:03:22.822273 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:22 dist-test-slave-7kzw krb5kdc[15658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:22.947619 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:36433
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:36219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:36433
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:23.030522 15677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:23.030776 15677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:23.030815 15677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:23.031946 15677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:23.032023 15677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:23.032047 15677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:23.032068 15677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:23.032095 15677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:23.033679 15677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:36219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:36433
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:36433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15677
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:23.033959 15677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:23.034199 15677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:23.039227 15686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:23.039227 15687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:23.039588 15677 server_base.cc:1034] running on GCE node
W20260808 05:03:23.039301 15692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:23.039973 15677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:23.040249 15677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:23.041399 15677 hybrid_clock.cc:648] HybridClock initialized: now 1786165403041381 us; error 44 us; skew 500 ppm
Aug 08 05:03:23 dist-test-slave-7kzw krb5kdc[15658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165403, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:23.048563 15677 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:23.049060 15677 webserver.cc:460] Webserver started at http://127.11.70.254:34033/ using document root <none> and password file <none>
I20260808 05:03:23.049299 15677 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:23.049341 15677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:23.049435 15677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:23.050565 15677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "6ac0997bacfc4ab3aff144a2b29ec123"
format_stamp: "Formatted at 2026-08-08 05:03:23 on dist-test-slave-7kzw"
server_key: "26864c6155373521d17de8d179205d37"
server_key_iv: "2c653861407cfe46e2703811de31bc3e"
server_key_version: "encryptionkey@0"
I20260808 05:03:23.050899 15677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "6ac0997bacfc4ab3aff144a2b29ec123"
format_stamp: "Formatted at 2026-08-08 05:03:23 on dist-test-slave-7kzw"
server_key: "26864c6155373521d17de8d179205d37"
server_key_iv: "2c653861407cfe46e2703811de31bc3e"
server_key_version: "encryptionkey@0"
I20260808 05:03:23.052214 15677 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:23.052937 15703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:23.053144 15677 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:23.053299 15677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "6ac0997bacfc4ab3aff144a2b29ec123"
format_stamp: "Formatted at 2026-08-08 05:03:23 on dist-test-slave-7kzw"
server_key: "26864c6155373521d17de8d179205d37"
server_key_iv: "2c653861407cfe46e2703811de31bc3e"
server_key_version: "encryptionkey@0"
I20260808 05:03:23.053426 15677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:23.069154 15677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:23.071066 15677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:23.071179 15677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:23.075451 15677 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:36433
I20260808 05:03:23.075488 15780 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:36433 every 8 connection(s)
I20260808 05:03:23.076102 15677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:23.076819 15781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:23.079155 15781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123: Bootstrap starting.
I20260808 05:03:23.079759 15781 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:23.080080 15781 log.cc:824] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:23.080767 15781 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123: No bootstrap required, opened a new log
I20260808 05:03:23.082396 15781 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac0997bacfc4ab3aff144a2b29ec123" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36433 } }
I20260808 05:03:23.082597 15781 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:23.082655 15781 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ac0997bacfc4ab3aff144a2b29ec123, State: Initialized, Role: FOLLOWER
I20260808 05:03:23.082808 15781 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac0997bacfc4ab3aff144a2b29ec123" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36433 } }
I20260808 05:03:23.082898 15781 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:23.082952 15781 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:23.083002 15781 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:23.083384 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 15677
I20260808 05:03:23.083485 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:23.083696 11547 external_mini_cluster.cc:1428] Setting key 0cac664b7f1d1f0bfb57c2fb530a771d
I20260808 05:03:23.084313 15781 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac0997bacfc4ab3aff144a2b29ec123" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36433 } }
I20260808 05:03:23.084425 15781 leader_election.cc:302] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ac0997bacfc4ab3aff144a2b29ec123; no voters:
I20260808 05:03:23.084605 15781 leader_election.cc:288] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:23.084637 15786 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:23.084755 15786 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [term 1 LEADER]: Becoming Leader. State: Replica: 6ac0997bacfc4ab3aff144a2b29ec123, State: Running, Role: LEADER
I20260808 05:03:23.084869 15781 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:23.084900 15786 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac0997bacfc4ab3aff144a2b29ec123" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36433 } }
I20260808 05:03:23.085253 15788 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ac0997bacfc4ab3aff144a2b29ec123" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac0997bacfc4ab3aff144a2b29ec123" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36433 } } }
I20260808 05:03:23.085361 15788 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:23.085237 15786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ac0997bacfc4ab3aff144a2b29ec123. Latest consensus state: current_term: 1 leader_uuid: "6ac0997bacfc4ab3aff144a2b29ec123" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ac0997bacfc4ab3aff144a2b29ec123" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36433 } } }
I20260808 05:03:23.085561 15786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:23.085697 15795 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:23.086230 15795 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:23.087927 15795 catalog_manager.cc:1347] Generated new cluster ID: 951e578375ea4b978e69805bfa3eb70f
I20260808 05:03:23.087980 15795 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:03:23 dist-test-slave-7kzw krb5kdc[15658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165402, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:23.096082 15785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:23.084194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34592 (local address 127.11.70.254:36433)
0808 05:03:23.084399 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:23.084409 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:23.084446 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:03:23.084588 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:23.084595 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:23.084664 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:23.084806 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:23.085805 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:23.087369 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:23.088411 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:23.088995 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:23.089103 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:23.092093 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:23.092098 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:23.092098 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:23.092111 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:23.094216 (+ 2105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:23.094632 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:23.094635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:23.094636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:23.094761 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:23.094978 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:23.094979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:23.094979 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:23.095322 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:23.095511 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:23.095582 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 05:03:23.095848 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":95,"threads_started":1}
I20260808 05:03:23.097359 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:03:23.099838 15795 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:23.100560 15795 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:23.104286 15795 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ac0997bacfc4ab3aff144a2b29ec123: Generated new TSK 0
I20260808 05:03:23.104462 15795 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:03:23.115746 15785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:23.111825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34598 (local address 127.11.70.254:36433)
0808 05:03:23.111883 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:23.111890 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:23.111988 (+ 98us) server_negotiation.cc:407] Connection header received
0808 05:03:23.112056 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:23.112057 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:23.112067 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:23.112126 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:23.112636 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:23.113137 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:23.114231 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:23.114450 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:23.114570 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:23.115308 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:23.115309 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:23.115309 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:23.115495 (+ 186us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:23.115512 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:23.115518 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:23.115573 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:23.115659 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 05:03:23.115689 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:03:23.118583 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 15677
2026-08-08T05:03:23Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1577 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:23 dist-test-slave-7kzw krb5kdc[15830](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:23 dist-test-slave-7kzw krb5kdc[15830](info): set up 2 sockets
Aug 08 05:03:23 dist-test-slave-7kzw krb5kdc[15830](info): commencing operation
krb5kdc: starting...
W20260808 05:03:24.334794 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.193s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:24 dist-test-slave-7kzw krb5kdc[15830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:24.461606 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:44093
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:44093
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:24.544799 15850 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:24.545061 15850 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:24.545104 15850 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:24.546280 15850 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:24.546353 15850 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:24.546377 15850 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:24.546401 15850 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:24.546433 15850 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:24.547972 15850 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:44093
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:44093
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15850
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:24.548254 15850 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:24.548493 15850 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:24.553586 15862 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:24.553596 15859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:24.553747 15850 server_base.cc:1034] running on GCE node
W20260808 05:03:24.553642 15858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:24.554081 15850 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:24.554410 15850 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:24.555615 15850 hybrid_clock.cc:648] HybridClock initialized: now 1786165404555615 us; error 44 us; skew 500 ppm
Aug 08 05:03:24 dist-test-slave-7kzw krb5kdc[15830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:24.558269 15850 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:24.558779 15850 webserver.cc:460] Webserver started at http://127.11.70.254:45693/ using document root <none> and password file <none>
I20260808 05:03:24.559032 15850 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:24.559101 15850 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:24.559258 15850 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:24.560307 15850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "fee9f2c7e903466fa384039c3875d716"
format_stamp: "Formatted at 2026-08-08 05:03:24 on dist-test-slave-7kzw"
server_key: "78baf405b6d831689f7cfb51ecd7d759"
server_key_iv: "b399c611386c1d2ef11b0948054f2453"
server_key_version: "encryptionkey@0"
I20260808 05:03:24.560664 15850 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "fee9f2c7e903466fa384039c3875d716"
format_stamp: "Formatted at 2026-08-08 05:03:24 on dist-test-slave-7kzw"
server_key: "78baf405b6d831689f7cfb51ecd7d759"
server_key_iv: "b399c611386c1d2ef11b0948054f2453"
server_key_version: "encryptionkey@0"
I20260808 05:03:24.562043 15850 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:24.562922 15875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:24.563127 15850 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:24.563248 15850 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "fee9f2c7e903466fa384039c3875d716"
format_stamp: "Formatted at 2026-08-08 05:03:24 on dist-test-slave-7kzw"
server_key: "78baf405b6d831689f7cfb51ecd7d759"
server_key_iv: "b399c611386c1d2ef11b0948054f2453"
server_key_version: "encryptionkey@0"
I20260808 05:03:24.563326 15850 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:24.577387 15850 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:24.579687 15850 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:24.579857 15850 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:24.584100 15850 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:44093
I20260808 05:03:24.584144 15961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:44093 every 8 connection(s)
I20260808 05:03:24.584522 15850 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:24.585700 15962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:24.586833 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 15850
I20260808 05:03:24.586922 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:24.587096 11547 external_mini_cluster.cc:1428] Setting key 5290de2f9cf21b42b556d17bc6fdfd73
I20260808 05:03:24.588507 15962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716: Bootstrap starting.
I20260808 05:03:24.589316 15962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:24.589651 15962 log.cc:824] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:24.590378 15962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716: No bootstrap required, opened a new log
I20260808 05:03:24.592865 15962 raft_consensus.cc:348] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fee9f2c7e903466fa384039c3875d716" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44093 } }
I20260808 05:03:24.593048 15962 raft_consensus.cc:374] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:24.593096 15962 raft_consensus.cc:729] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fee9f2c7e903466fa384039c3875d716, State: Initialized, Role: FOLLOWER
I20260808 05:03:24.593241 15962 consensus_queue.cc:260] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fee9f2c7e903466fa384039c3875d716" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44093 } }
I20260808 05:03:24.593365 15962 raft_consensus.cc:388] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:24.593405 15962 raft_consensus.cc:482] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:24.593457 15962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:24.594148 15962 raft_consensus.cc:504] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fee9f2c7e903466fa384039c3875d716" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44093 } }
I20260808 05:03:24.594240 15962 leader_election.cc:302] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fee9f2c7e903466fa384039c3875d716; no voters:
Aug 08 05:03:24 dist-test-slave-7kzw krb5kdc[15830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:24.594449 15962 leader_election.cc:288] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:24.594503 15970 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:24.594635 15970 raft_consensus.cc:686] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [term 1 LEADER]: Becoming Leader. State: Replica: fee9f2c7e903466fa384039c3875d716, State: Running, Role: LEADER
I20260808 05:03:24.594758 15962 sys_catalog.cc:564] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:24.594745 15970 consensus_queue.cc:237] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fee9f2c7e903466fa384039c3875d716" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44093 } }
I20260808 05:03:24.595088 15970 sys_catalog.cc:455] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fee9f2c7e903466fa384039c3875d716" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fee9f2c7e903466fa384039c3875d716" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44093 } } }
I20260808 05:03:24.595263 15970 sys_catalog.cc:458] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:24.595425 15970 sys_catalog.cc:455] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fee9f2c7e903466fa384039c3875d716. Latest consensus state: current_term: 1 leader_uuid: "fee9f2c7e903466fa384039c3875d716" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fee9f2c7e903466fa384039c3875d716" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44093 } } }
I20260808 05:03:24.595490 15981 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:24.595501 15970 sys_catalog.cc:458] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:24.596553 15981 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:24.598242 15981 catalog_manager.cc:1347] Generated new cluster ID: 298c017e9be24b96ab98e2fbef85ade1
I20260808 05:03:24.598289 15981 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:24.599020 15967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:24.587625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50070 (local address 127.11.70.254:44093)
0808 05:03:24.587815 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:24.587823 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:24.587848 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:03:24.588312 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:24.588318 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:24.588363 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:24.588475 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:24.589393 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.590556 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.591606 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.592006 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.592082 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:24.594962 (+ 2880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:24.594967 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:24.594967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:24.594979 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:24.597330 (+ 2351us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:24.597734 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:24.597737 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:24.597737 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:24.597848 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:24.598071 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:24.598072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:24.598073 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:24.598385 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:24.598562 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:24.598694 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 05:03:24.598830 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":105,"threads_started":1}
I20260808 05:03:24.616641 15981 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:24.617151 15981 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:24.627241 15981 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fee9f2c7e903466fa384039c3875d716: Generated new TSK 0
I20260808 05:03:24.627456 15981 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:24.660936 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:44093
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:24.751379 16001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:24.751578 16001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:24.751601 16001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:24.752668 16001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:24.752704 16001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:24.752729 16001 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:24.754074 16001 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:44093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:24.754269 16001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:24.754446 16001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:24.759583 16012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:24.759640 16009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:24.759781 16010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:24.759840 16001 server_base.cc:1034] running on GCE node
I20260808 05:03:24.760083 16001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:24.760293 16001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:24.761442 16001 hybrid_clock.cc:648] HybridClock initialized: now 1786165404761429 us; error 29 us; skew 500 ppm
Aug 08 05:03:24 dist-test-slave-7kzw krb5kdc[15830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:24.764087 16001 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:24.764580 16001 webserver.cc:460] Webserver started at http://127.11.70.193:36451/ using document root <none> and password file <none>
I20260808 05:03:24.764814 16001 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:24.764861 16001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:24.765025 16001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:24.766117 16001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "d3cd623df93d4cfbae41dea570cf8493"
format_stamp: "Formatted at 2026-08-08 05:03:24 on dist-test-slave-7kzw"
server_key: "a56b95826fd20c11734e1dd69acfab8f"
server_key_iv: "0b4fa2cd787c2d97b84213d31dfbb79d"
server_key_version: "encryptionkey@0"
I20260808 05:03:24.766552 16001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "d3cd623df93d4cfbae41dea570cf8493"
format_stamp: "Formatted at 2026-08-08 05:03:24 on dist-test-slave-7kzw"
server_key: "a56b95826fd20c11734e1dd69acfab8f"
server_key_iv: "0b4fa2cd787c2d97b84213d31dfbb79d"
server_key_version: "encryptionkey@0"
I20260808 05:03:24.768034 16001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:24.768821 16025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:24.769022 16001 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:24.769120 16001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "d3cd623df93d4cfbae41dea570cf8493"
format_stamp: "Formatted at 2026-08-08 05:03:24 on dist-test-slave-7kzw"
server_key: "a56b95826fd20c11734e1dd69acfab8f"
server_key_iv: "0b4fa2cd787c2d97b84213d31dfbb79d"
server_key_version: "encryptionkey@0"
I20260808 05:03:24.769199 16001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:24.784349 16001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:24.786345 16001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:24.786535 16001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:24.786811 16001 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:24.787094 16001 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:24.787127 16001 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:24.787150 16001 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:24.787163 16001 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:24.793380 16001 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:33509
I20260808 05:03:24.793427 16204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:33509 every 8 connection(s)
I20260808 05:03:24.793761 16001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:24.797583 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 16001
I20260808 05:03:24.797708 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:24.797928 11547 external_mini_cluster.cc:1428] Setting key 8f41bfa845f8263b596437fcb0e581a5
Aug 08 05:03:24 dist-test-slave-7kzw krb5kdc[15830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:24.804672 15967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:24.794545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:41493 (local address 127.11.70.254:44093)
0808 05:03:24.794600 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:24.794601 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:24.794826 (+ 225us) server_negotiation.cc:407] Connection header received
0808 05:03:24.795453 (+ 627us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:24.795454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:24.795471 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:24.795529 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:24.796600 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.797101 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.798303 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.798618 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.798688 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:24.801329 (+ 2641us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:24.801331 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:24.801331 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:24.801339 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:24.802860 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:24.803482 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:24.803483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:24.803483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:24.803590 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:24.803938 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:24.803939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:24.803939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:24.804074 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:24.804133 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:24.804507 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 05:03:24.804598 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:03:24.804996 16207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:24.794466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:44093 (local address 127.11.70.193:41493)
0808 05:03:24.794692 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:24.794736 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:24.795354 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:24.795582 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:24.795586 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:24.796264 (+ 678us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:24.796513 (+ 249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:24.796519 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.797180 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.797181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:24.798223 (+ 1042us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:24.798226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.798706 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.798707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:24.798846 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:24.799431 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:24.799440 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:24.801224 (+ 1784us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:24.802943 (+ 1719us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:24.802951 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:24.802954 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:24.803364 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:24.803683 (+ 319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:24.803684 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:24.803685 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:24.803857 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:24.804146 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:24.804153 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:24.804352 (+ 199us) client_negotiation.cc:769] Sending connection context
0808 05:03:24.804484 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 05:03:24.804689 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260808 05:03:24.805591 16205 heartbeater.cc:347] Connected to a master server at 127.11.70.254:44093
I20260808 05:03:24.805691 16205 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:24.805894 16205 heartbeater.cc:511] Master 127.11.70.254:44093 requested a full tablet report, sending...
I20260808 05:03:24.806560 15903 ts_manager.cc:194] Registered new tserver with Master: d3cd623df93d4cfbae41dea570cf8493 (127.11.70.193:33509)
I20260808 05:03:24.807189 15903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:41493
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:24.827832 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:44093
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:24.912675 16212 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:24.912915 16212 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:24.912956 16212 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:24.914093 16212 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:24.914158 16212 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:24.914203 16212 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:24.915722 16212 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:44093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16212
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:24.915982 16212 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:24.916224 16212 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:24.921411 16222 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:24.921494 16212 server_base.cc:1034] running on GCE node
W20260808 05:03:24.921411 16226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:24.921466 16218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:24.921937 16212 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:24.922137 16212 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:24.923280 16212 hybrid_clock.cc:648] HybridClock initialized: now 1786165404923254 us; error 37 us; skew 500 ppm
Aug 08 05:03:24 dist-test-slave-7kzw krb5kdc[15830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:24.925823 16212 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:24.926190 16212 webserver.cc:460] Webserver started at http://127.11.70.194:39367/ using document root <none> and password file <none>
I20260808 05:03:24.926380 16212 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:24.926420 16212 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:24.926575 16212 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:24.927560 16212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "5590f10d4a65406196dcb3e536d63251"
format_stamp: "Formatted at 2026-08-08 05:03:24 on dist-test-slave-7kzw"
server_key: "1ce2c20ec54cce2bab840e6a20f33aa0"
server_key_iv: "9d6da13bf9e112b1105f5784bb6b5ac6"
server_key_version: "encryptionkey@0"
I20260808 05:03:24.927870 16212 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "5590f10d4a65406196dcb3e536d63251"
format_stamp: "Formatted at 2026-08-08 05:03:24 on dist-test-slave-7kzw"
server_key: "1ce2c20ec54cce2bab840e6a20f33aa0"
server_key_iv: "9d6da13bf9e112b1105f5784bb6b5ac6"
server_key_version: "encryptionkey@0"
I20260808 05:03:24.929111 16212 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:24.929774 16235 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:24.929952 16212 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:24.930061 16212 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "5590f10d4a65406196dcb3e536d63251"
format_stamp: "Formatted at 2026-08-08 05:03:24 on dist-test-slave-7kzw"
server_key: "1ce2c20ec54cce2bab840e6a20f33aa0"
server_key_iv: "9d6da13bf9e112b1105f5784bb6b5ac6"
server_key_version: "encryptionkey@0"
I20260808 05:03:24.930135 16212 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:24.963081 16212 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:24.965034 16212 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:24.965248 16212 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:24.965553 16212 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:24.965912 16212 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:24.965971 16212 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:24.966017 16212 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:24.966043 16212 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:24.972246 16212 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:32781
I20260808 05:03:24.972332 16410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:32781 every 8 connection(s)
I20260808 05:03:24.972656 16212 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:24.973855 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 16212
I20260808 05:03:24.973938 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:24.974164 11547 external_mini_cluster.cc:1428] Setting key 36c8e824ef66e40181ae24400ad9108a
Aug 08 05:03:24 dist-test-slave-7kzw krb5kdc[15830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165404, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:24.982595 15967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:24.973376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:39513 (local address 127.11.70.254:44093)
0808 05:03:24.973446 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:24.973448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:24.973647 (+ 199us) server_negotiation.cc:407] Connection header received
0808 05:03:24.974299 (+ 652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:24.974301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:24.974314 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:24.974364 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:24.975471 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.975971 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.976960 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.977177 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.977273 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:24.979456 (+ 2183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:24.979458 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:24.979458 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:24.979466 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:24.981143 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:24.981550 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:24.981551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:24.981552 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:24.981619 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:24.981864 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:24.981865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:24.981865 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:24.982018 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:24.982091 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:24.982357 (+ 266us) server_negotiation.cc:299] Negotiation successful
0808 05:03:24.982449 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:03:24.982699 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:24.973366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:44093 (local address 127.11.70.194:39513)
0808 05:03:24.973530 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:24.973566 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:24.974174 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:24.974434 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:24.974438 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:24.975163 (+ 725us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:24.975361 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:24.975366 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.976076 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.976077 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:24.976871 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:24.976873 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:24.977284 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:24.977285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:24.977416 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:24.977963 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:24.977972 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:24.979360 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:24.981234 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:24.981240 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:24.981242 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:24.981470 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:24.981694 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:24.981694 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:24.981695 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:24.981794 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:24.982094 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:24.982099 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:24.982217 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 05:03:24.982302 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 05:03:24.982419 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
I20260808 05:03:24.983235 16411 heartbeater.cc:347] Connected to a master server at 127.11.70.254:44093
I20260808 05:03:24.983345 16411 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:24.983525 16411 heartbeater.cc:511] Master 127.11.70.254:44093 requested a full tablet report, sending...
I20260808 05:03:24.983953 15903 ts_manager.cc:194] Registered new tserver with Master: 5590f10d4a65406196dcb3e536d63251 (127.11.70.194:32781)
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
I20260808 05:03:24.984445 15903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:39513
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:25.005926 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:44093
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42469
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:25.092386 16418 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:25.092592 16418 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:25.092615 16418 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:25.093727 16418 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:25.093770 16418 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:25.093796 16418 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:25.095403 16418 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42469
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:44093
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16418
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:25.095649 16418 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:25.095872 16418 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:25.101105 16428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:25.101130 16424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:25.101125 16426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:25.101177 16418 server_base.cc:1034] running on GCE node
I20260808 05:03:25.101557 16418 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:25.101835 16418 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:25.102999 16418 hybrid_clock.cc:648] HybridClock initialized: now 1786165405102987 us; error 30 us; skew 500 ppm
Aug 08 05:03:25 dist-test-slave-7kzw krb5kdc[15830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165405, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:25.105655 16418 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:25.106123 16418 webserver.cc:460] Webserver started at http://127.11.70.195:34247/ using document root <none> and password file <none>
I20260808 05:03:25.106364 16418 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:25.106410 16418 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:25.106613 16418 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:25.107681 16418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "00252eab850541bcba19f01f6479c271"
format_stamp: "Formatted at 2026-08-08 05:03:25 on dist-test-slave-7kzw"
server_key: "524980fcb6f06357950f82722f0c34b9"
server_key_iv: "5b98beb616cfc03813d6ea9184d2b697"
server_key_version: "encryptionkey@0"
I20260808 05:03:25.108043 16418 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "00252eab850541bcba19f01f6479c271"
format_stamp: "Formatted at 2026-08-08 05:03:25 on dist-test-slave-7kzw"
server_key: "524980fcb6f06357950f82722f0c34b9"
server_key_iv: "5b98beb616cfc03813d6ea9184d2b697"
server_key_version: "encryptionkey@0"
I20260808 05:03:25.109407 16418 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:25.110186 16437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:25.110481 16418 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:25.110576 16418 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "00252eab850541bcba19f01f6479c271"
format_stamp: "Formatted at 2026-08-08 05:03:25 on dist-test-slave-7kzw"
server_key: "524980fcb6f06357950f82722f0c34b9"
server_key_iv: "5b98beb616cfc03813d6ea9184d2b697"
server_key_version: "encryptionkey@0"
I20260808 05:03:25.110632 16418 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:25.133074 16418 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:25.135179 16418 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:25.135300 16418 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:25.135479 16418 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:25.135814 16418 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:25.135849 16418 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:25.135872 16418 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:25.135921 16418 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:25.142203 16418 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:46591
I20260808 05:03:25.142288 16591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:46591 every 8 connection(s)
I20260808 05:03:25.142647 16418 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:03:25 dist-test-slave-7kzw krb5kdc[15830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165405, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:25.151419 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 16418
I20260808 05:03:25.151499 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:25.151716 11547 external_mini_cluster.cc:1428] Setting key 7863aad69cda497dbf25a85805261e93
I20260808 05:03:25.152218 15967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:25.143445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:40707 (local address 127.11.70.254:44093)
0808 05:03:25.143510 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:25.143512 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:25.143716 (+ 204us) server_negotiation.cc:407] Connection header received
0808 05:03:25.144271 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:25.144273 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:25.144286 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:25.144343 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:25.145332 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:25.145840 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:25.146940 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:25.147140 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:25.147218 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:25.149365 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:25.149366 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:25.149367 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:25.149376 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:25.150693 (+ 1317us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:25.151110 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:25.151111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:25.151111 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:25.151175 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:25.151446 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:25.151447 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:25.151448 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:25.151594 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:25.151705 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:25.152029 (+ 324us) server_negotiation.cc:299] Negotiation successful
0808 05:03:25.152123 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:03:25.152416 16596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:25.143363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:44093 (local address 127.11.70.195:40707)
0808 05:03:25.143576 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:25.143626 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:25.144160 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:25.144411 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:25.144415 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:25.145023 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:25.145224 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:25.145229 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:25.145952 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:25.145953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:25.146849 (+ 896us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:25.146852 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:25.147228 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:25.147229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:25.147367 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:25.147893 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:25.147902 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:25.149260 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:25.150774 (+ 1514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:25.150782 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:25.150784 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:25.151014 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:25.151255 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:25.151256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:25.151256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:25.151376 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:25.151696 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:25.151703 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:25.151885 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 05:03:25.152003 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 05:03:25.152171 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":98,"threads_started":1}
I20260808 05:03:25.152940 16592 heartbeater.cc:347] Connected to a master server at 127.11.70.254:44093
I20260808 05:03:25.153019 16592 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:25.153163 16592 heartbeater.cc:511] Master 127.11.70.254:44093 requested a full tablet report, sending...
I20260808 05:03:25.153456 15903 ts_manager.cc:194] Registered new tserver with Master: 00252eab850541bcba19f01f6479c271 (127.11.70.195:46591)
I20260808 05:03:25.153832 15903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:40707
I20260808 05:03:25.163561 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:03:25 dist-test-slave-7kzw krb5kdc[15830](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165405, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 05:03:25 dist-test-slave-7kzw krb5kdc[15830](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165405, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:25.187203 15967 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:25.180577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50084 (local address 127.11.70.254:44093)
0808 05:03:25.180658 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:25.180659 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:25.180722 (+ 63us) server_negotiation.cc:407] Connection header received
0808 05:03:25.180769 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:25.180770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:25.180779 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:25.180832 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:25.181391 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:25.181886 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:25.182650 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:25.182831 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:25.182885 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:25.184969 (+ 2084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:25.184970 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:25.184970 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:25.184977 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:25.186162 (+ 1185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:25.186503 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:25.186504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:25.186504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:25.186567 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:25.186768 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:25.186769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:25.186769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:25.186913 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:25.186994 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:25.187075 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 05:03:25.187137 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
W20260808 05:03:25.187481 15903 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:50084
I20260808 05:03:25.187969 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 16001
I20260808 05:03:25.199110 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 16212
I20260808 05:03:25.212026 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 16418
I20260808 05:03:25.225607 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 15850
2026-08-08T05:03:25Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2108 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:25 dist-test-slave-7kzw krb5kdc[16610](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:25 dist-test-slave-7kzw krb5kdc[16610](info): set up 2 sockets
Aug 08 05:03:25 dist-test-slave-7kzw krb5kdc[16610](info): commencing operation
krb5kdc: starting...
W20260808 05:03:26.496080 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.245s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:26 dist-test-slave-7kzw krb5kdc[16610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:26.621719 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:36631
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:36631
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:26.711097 16630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:26.711290 16630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:26.711313 16630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:26.712441 16630 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:26.712484 16630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:26.712498 16630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:26.712538 16630 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:26.712567 16630 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:26.714025 16630 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:36631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:36631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:26.714282 16630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:26.714531 16630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:26.719483 16635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:26.719498 16636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:26.719775 16630 server_base.cc:1034] running on GCE node
W20260808 05:03:26.719532 16639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:26.720103 16630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:26.720399 16630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:26.721571 16630 hybrid_clock.cc:648] HybridClock initialized: now 1786165406721554 us; error 60 us; skew 500 ppm
Aug 08 05:03:26 dist-test-slave-7kzw krb5kdc[16610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165406, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:26.724131 16630 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:26.724567 16630 webserver.cc:460] Webserver started at http://127.11.70.254:38875/ using document root <none> and password file <none>
I20260808 05:03:26.724812 16630 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:26.724879 16630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:26.725029 16630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:26.726059 16630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "b495ace692464564842011d904b5af43"
format_stamp: "Formatted at 2026-08-08 05:03:26 on dist-test-slave-7kzw"
server_key: "b92c5e45ebbda2dc86544097db4e53ba"
server_key_iv: "ca5ed92c526c88c55420ccdc9032cb63"
server_key_version: "encryptionkey@0"
I20260808 05:03:26.726436 16630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "b495ace692464564842011d904b5af43"
format_stamp: "Formatted at 2026-08-08 05:03:26 on dist-test-slave-7kzw"
server_key: "b92c5e45ebbda2dc86544097db4e53ba"
server_key_iv: "ca5ed92c526c88c55420ccdc9032cb63"
server_key_version: "encryptionkey@0"
I20260808 05:03:26.727909 16630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:26.728663 16647 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:26.728845 16630 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:26.728947 16630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "b495ace692464564842011d904b5af43"
format_stamp: "Formatted at 2026-08-08 05:03:26 on dist-test-slave-7kzw"
server_key: "b92c5e45ebbda2dc86544097db4e53ba"
server_key_iv: "ca5ed92c526c88c55420ccdc9032cb63"
server_key_version: "encryptionkey@0"
I20260808 05:03:26.729030 16630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:26.739193 16630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:26.741146 16630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:26.741321 16630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:26.745450 16630 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:36631
I20260808 05:03:26.745743 16723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:36631 every 8 connection(s)
I20260808 05:03:26.745838 16630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:26.746572 16724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:26.747011 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 16630
I20260808 05:03:26.747123 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:26.747326 11547 external_mini_cluster.cc:1428] Setting key 9306746fc19788f6ac7e6abdf1647990
I20260808 05:03:26.749724 16724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43: Bootstrap starting.
I20260808 05:03:26.750443 16724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:26.750809 16724 log.cc:824] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:26.751483 16724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43: No bootstrap required, opened a new log
I20260808 05:03:26.753621 16724 raft_consensus.cc:348] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b495ace692464564842011d904b5af43" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36631 } }
I20260808 05:03:26.753791 16724 raft_consensus.cc:374] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:26.753834 16724 raft_consensus.cc:729] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b495ace692464564842011d904b5af43, State: Initialized, Role: FOLLOWER
I20260808 05:03:26.753969 16724 consensus_queue.cc:260] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b495ace692464564842011d904b5af43" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36631 } }
I20260808 05:03:26.754050 16724 raft_consensus.cc:388] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:26.754088 16724 raft_consensus.cc:482] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
Aug 08 05:03:26 dist-test-slave-7kzw krb5kdc[16610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165406, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:26.754137 16724 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:26.754849 16724 raft_consensus.cc:504] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b495ace692464564842011d904b5af43" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36631 } }
I20260808 05:03:26.754941 16724 leader_election.cc:302] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b495ace692464564842011d904b5af43; no voters:
I20260808 05:03:26.755146 16724 leader_election.cc:288] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:26.755201 16730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:26.755396 16730 raft_consensus.cc:686] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [term 1 LEADER]: Becoming Leader. State: Replica: b495ace692464564842011d904b5af43, State: Running, Role: LEADER
I20260808 05:03:26.755445 16724 sys_catalog.cc:564] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:26.755504 16730 consensus_queue.cc:237] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b495ace692464564842011d904b5af43" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36631 } }
I20260808 05:03:26.756003 16730 sys_catalog.cc:455] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b495ace692464564842011d904b5af43. Latest consensus state: current_term: 1 leader_uuid: "b495ace692464564842011d904b5af43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b495ace692464564842011d904b5af43" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36631 } } }
I20260808 05:03:26.756256 16730 sys_catalog.cc:458] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:26.756182 16731 sys_catalog.cc:455] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b495ace692464564842011d904b5af43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b495ace692464564842011d904b5af43" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36631 } } }
I20260808 05:03:26.756701 16731 sys_catalog.cc:458] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:26.756839 16741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:26.757364 16741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:26.759055 16741 catalog_manager.cc:1347] Generated new cluster ID: e0ff963c020d4eb58a8b855f0ca50737
I20260808 05:03:26.759109 16741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:26.759316 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:26.747863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34206 (local address 127.11.70.254:36631)
0808 05:03:26.748055 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:26.748066 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:26.748097 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:03:26.748660 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:26.748668 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:26.748726 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:26.748871 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:26.749475 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:26.750823 (+ 1348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:26.751599 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:26.751998 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:26.752129 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:26.754712 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:26.754716 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:26.754716 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:26.754727 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:26.757012 (+ 2285us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:26.757587 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:26.757590 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:26.757590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:26.757719 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:26.757986 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:26.757987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:26.757987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:26.758349 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:26.758526 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:26.758962 (+ 436us) server_negotiation.cc:299] Negotiation successful
0808 05:03:26.759108 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":62,"threads_started":1}
I20260808 05:03:26.767524 16741 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:26.768227 16741 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:26.772537 16741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b495ace692464564842011d904b5af43: Generated new TSK 0
I20260808 05:03:26.772703 16741 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:26.807528 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36631
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:26.891856 16765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:26.892083 16765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:26.892122 16765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:26.893261 16765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:26.893327 16765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:26.893369 16765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:26.894963 16765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:26.895231 16765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:26.895473 16765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:26.900785 16779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:26.900810 16774 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:26.900785 16777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:26.901047 16765 server_base.cc:1034] running on GCE node
I20260808 05:03:26.901306 16765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:26.901559 16765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:26.902758 16765 hybrid_clock.cc:648] HybridClock initialized: now 1786165406902750 us; error 37 us; skew 500 ppm
Aug 08 05:03:26 dist-test-slave-7kzw krb5kdc[16610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165406, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:26.905534 16765 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:26.906040 16765 webserver.cc:460] Webserver started at http://127.11.70.193:45143/ using document root <none> and password file <none>
I20260808 05:03:26.906298 16765 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:26.906376 16765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:26.906560 16765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:26.907635 16765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "b1d37d161ae74169a27bdad65f735a36"
format_stamp: "Formatted at 2026-08-08 05:03:26 on dist-test-slave-7kzw"
server_key: "27ca161065e6724f7a3a676feaddd039"
server_key_iv: "b2e0992557ab31e1c8ef25c64b1af822"
server_key_version: "encryptionkey@0"
I20260808 05:03:26.908077 16765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "b1d37d161ae74169a27bdad65f735a36"
format_stamp: "Formatted at 2026-08-08 05:03:26 on dist-test-slave-7kzw"
server_key: "27ca161065e6724f7a3a676feaddd039"
server_key_iv: "b2e0992557ab31e1c8ef25c64b1af822"
server_key_version: "encryptionkey@0"
I20260808 05:03:26.909586 16765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:26.910322 16791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:26.910605 16765 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:26.910717 16765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "b1d37d161ae74169a27bdad65f735a36"
format_stamp: "Formatted at 2026-08-08 05:03:26 on dist-test-slave-7kzw"
server_key: "27ca161065e6724f7a3a676feaddd039"
server_key_iv: "b2e0992557ab31e1c8ef25c64b1af822"
server_key_version: "encryptionkey@0"
I20260808 05:03:26.910804 16765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:26.924700 16765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:26.926776 16765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:26.926935 16765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:26.927165 16765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:26.927497 16765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:26.927557 16765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:26.927599 16765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:26.927628 16765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:26.934088 16765 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:38895
I20260808 05:03:26.934194 16948 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:38895 every 8 connection(s)
I20260808 05:03:26.934546 16765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:03:26 dist-test-slave-7kzw krb5kdc[16610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165406, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:26.943403 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 16765
I20260808 05:03:26.943527 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:26.943746 11547 external_mini_cluster.cc:1428] Setting key 0de03c3a4fcc586550104d45c0f7fa13
I20260808 05:03:26.944139 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:26.935308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:41695 (local address 127.11.70.254:36631)
0808 05:03:26.935374 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:26.935376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:26.935595 (+ 219us) server_negotiation.cc:407] Connection header received
0808 05:03:26.936509 (+ 914us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:26.936509 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:26.936519 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:26.936626 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:26.937197 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:26.937745 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:26.938794 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:26.938999 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:26.939054 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:26.941160 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:26.941161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:26.941161 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:26.941168 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:26.942569 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:26.942998 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:26.942998 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:26.942999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:26.943050 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:26.943333 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:26.943335 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:26.943335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:26.943475 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:26.943615 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:26.943926 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 05:03:26.944039 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:03:26.944290 16953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:26.935292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:36631 (local address 127.11.70.193:41695)
0808 05:03:26.935464 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:26.935507 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:26.936420 (+ 913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:26.936683 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:26.936686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:26.936932 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:26.937123 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:26.937127 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:26.937837 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:26.937837 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:26.938724 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:26.938726 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:26.939080 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:26.939081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:26.939185 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:26.939602 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:26.939611 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:26.941064 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:26.942686 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:26.942694 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:26.942696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:26.942927 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:26.943116 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:26.943116 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:26.943117 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:26.943244 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:26.943613 (+ 369us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:26.943622 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:26.943751 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 05:03:26.943869 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 05:03:26.944054 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260808 05:03:26.944823 16949 heartbeater.cc:347] Connected to a master server at 127.11.70.254:36631
I20260808 05:03:26.944911 16949 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:26.945112 16949 heartbeater.cc:511] Master 127.11.70.254:36631 requested a full tablet report, sending...
I20260808 05:03:26.945662 16672 ts_manager.cc:194] Registered new tserver with Master: b1d37d161ae74169a27bdad65f735a36 (127.11.70.193:38895)
I20260808 05:03:26.946272 16672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:41695
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:26.973274 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36631
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:27.059091 16957 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:27.059336 16957 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:27.059376 16957 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:27.060506 16957 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:27.060573 16957 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:27.060617 16957 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:27.062135 16957 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16957
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:27.062408 16957 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:27.062655 16957 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:27.067898 16964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:27.067903 16967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:27.067967 16965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:27.068115 16957 server_base.cc:1034] running on GCE node
I20260808 05:03:27.068814 16957 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:27.069121 16957 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:27.070339 16957 hybrid_clock.cc:648] HybridClock initialized: now 1786165407070318 us; error 33 us; skew 500 ppm
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[16610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165407, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:27.073318 16957 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:27.073856 16957 webserver.cc:460] Webserver started at http://127.11.70.194:36269/ using document root <none> and password file <none>
I20260808 05:03:27.074080 16957 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:27.074127 16957 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:27.074222 16957 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:27.075306 16957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "2c8d6ed5070c4c3187b595689bac58d5"
format_stamp: "Formatted at 2026-08-08 05:03:27 on dist-test-slave-7kzw"
server_key: "b10b7fb91991eaab44d831962a6cc93c"
server_key_iv: "68fba7e000e9e8c2f5a7b7549c4bc914"
server_key_version: "encryptionkey@0"
I20260808 05:03:27.075640 16957 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "2c8d6ed5070c4c3187b595689bac58d5"
format_stamp: "Formatted at 2026-08-08 05:03:27 on dist-test-slave-7kzw"
server_key: "b10b7fb91991eaab44d831962a6cc93c"
server_key_iv: "68fba7e000e9e8c2f5a7b7549c4bc914"
server_key_version: "encryptionkey@0"
I20260808 05:03:27.077031 16957 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:03:27.077785 16979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:27.077986 16957 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:27.078109 16957 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "2c8d6ed5070c4c3187b595689bac58d5"
format_stamp: "Formatted at 2026-08-08 05:03:27 on dist-test-slave-7kzw"
server_key: "b10b7fb91991eaab44d831962a6cc93c"
server_key_iv: "68fba7e000e9e8c2f5a7b7549c4bc914"
server_key_version: "encryptionkey@0"
I20260808 05:03:27.078202 16957 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:27.093060 16957 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:27.095021 16957 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:27.095197 16957 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:27.095445 16957 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:27.095816 16957 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:27.095878 16957 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:27.095927 16957 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:27.095955 16957 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:27.102733 16957 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:34971
I20260808 05:03:27.102789 17147 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:34971 every 8 connection(s)
I20260808 05:03:27.103168 16957 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:27.109068 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 16957
I20260808 05:03:27.109220 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:27.109428 11547 external_mini_cluster.cc:1428] Setting key 9b21559333bbc0816ef21bbc0046e316
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[16610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165407, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:27.114023 17150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:27.103914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:36631 (local address 127.11.70.194:45509)
0808 05:03:27.104136 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:27.104190 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:27.105200 (+ 1010us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:27.105488 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:27.105492 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:27.105786 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:27.105983 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:27.105988 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.106833 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.106835 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:27.107681 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:27.107683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.108138 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.108139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:27.108284 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:27.108768 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:27.108777 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:27.110567 (+ 1790us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:27.112551 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:27.112558 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:27.112559 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:27.112784 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:27.113002 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:27.113003 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:27.113003 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:27.113110 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:27.113484 (+ 374us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:27.113492 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:27.113642 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 05:03:27.113734 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 05:03:27.113856 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":94,"threads_started":1}
I20260808 05:03:27.114054 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:27.103996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:45509 (local address 127.11.70.254:36631)
0808 05:03:27.104099 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:27.104102 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:27.104286 (+ 184us) server_negotiation.cc:407] Connection header received
0808 05:03:27.105338 (+ 1052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:27.105340 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:27.105356 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:27.105418 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:27.106108 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.106726 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.107804 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.108031 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.108125 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:27.110668 (+ 2543us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:27.110669 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:27.110669 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:27.110677 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:27.112464 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:27.112860 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:27.112861 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:27.112861 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:27.112932 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:27.113205 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:27.113206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:27.113206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:27.113374 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:27.113482 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:27.113788 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 05:03:27.113914 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260808 05:03:27.118613 17148 heartbeater.cc:347] Connected to a master server at 127.11.70.254:36631
I20260808 05:03:27.118739 17148 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
I20260808 05:03:27.118933 17148 heartbeater.cc:511] Master 127.11.70.254:36631 requested a full tablet report, sending...
I20260808 05:03:27.119431 16672 ts_manager.cc:194] Registered new tserver with Master: 2c8d6ed5070c4c3187b595689bac58d5 (127.11.70.194:34971)
I20260808 05:03:27.119765 16672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:45509
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:27.137780 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36631
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:27.220930 17153 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:27.221174 17153 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:27.221215 17153 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:27.222343 17153 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:27.222410 17153 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:27.222468 17153 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:27.224004 17153 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17153
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:27.224289 17153 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:27.224531 17153 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:27.229785 17161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:27.229816 17160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:27.229813 17164 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:27.230252 17153 server_base.cc:1034] running on GCE node
I20260808 05:03:27.230538 17153 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:27.230798 17153 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:27.231968 17153 hybrid_clock.cc:648] HybridClock initialized: now 1786165407231946 us; error 27 us; skew 500 ppm
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[16610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165407, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:27.234747 17153 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:27.235250 17153 webserver.cc:460] Webserver started at http://127.11.70.195:36359/ using document root <none> and password file <none>
I20260808 05:03:27.235504 17153 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:27.235579 17153 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:27.235735 17153 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:27.236871 17153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "77036c97a07e454b9764eb24f32f42dd"
format_stamp: "Formatted at 2026-08-08 05:03:27 on dist-test-slave-7kzw"
server_key: "c9f7348f8d091c4fd15859e450f98d97"
server_key_iv: "2e8919b58ddf04072b3dac4d193d797f"
server_key_version: "encryptionkey@0"
I20260808 05:03:27.237262 17153 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "77036c97a07e454b9764eb24f32f42dd"
format_stamp: "Formatted at 2026-08-08 05:03:27 on dist-test-slave-7kzw"
server_key: "c9f7348f8d091c4fd15859e450f98d97"
server_key_iv: "2e8919b58ddf04072b3dac4d193d797f"
server_key_version: "encryptionkey@0"
I20260808 05:03:27.238787 17153 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:27.239624 17172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:27.239809 17153 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:27.239925 17153 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "77036c97a07e454b9764eb24f32f42dd"
format_stamp: "Formatted at 2026-08-08 05:03:27 on dist-test-slave-7kzw"
server_key: "c9f7348f8d091c4fd15859e450f98d97"
server_key_iv: "2e8919b58ddf04072b3dac4d193d797f"
server_key_version: "encryptionkey@0"
I20260808 05:03:27.240006 17153 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:27.254347 17153 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:27.256968 17153 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:27.257140 17153 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:27.257397 17153 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:27.257671 17153 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:27.257704 17153 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:27.257727 17153 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:27.257740 17153 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:27.264083 17153 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:42305
I20260808 05:03:27.264189 17346 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:42305 every 8 connection(s)
I20260808 05:03:27.264510 17153 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[16610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165407, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:27.273378 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 17153
I20260808 05:03:27.273512 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:27.273811 11547 external_mini_cluster.cc:1428] Setting key e3dd1ea5a7233665fb7273ce7ad3a7bd
I20260808 05:03:27.274989 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:27.265364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:35757 (local address 127.11.70.254:36631)
0808 05:03:27.265444 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:27.265446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:27.265613 (+ 167us) server_negotiation.cc:407] Connection header received
0808 05:03:27.266614 (+ 1001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:27.266615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:27.266628 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:27.266705 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:27.267326 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.267903 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.268862 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.269064 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.269128 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:27.271581 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:27.271582 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:27.271583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:27.271591 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:27.273227 (+ 1636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:27.273794 (+ 567us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:27.273794 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:27.273795 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:27.273875 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:27.274217 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:27.274218 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:27.274219 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:27.274371 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:27.274445 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:27.274811 (+ 366us) server_negotiation.cc:299] Negotiation successful
0808 05:03:27.274894 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:03:27.275182 17351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:27.265286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:36631 (local address 127.11.70.195:35757)
0808 05:03:27.265477 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:27.265520 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:27.266444 (+ 924us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:27.266760 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:27.266763 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:27.267017 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:27.267214 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:27.267219 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.267992 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.267992 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:27.268772 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:27.268775 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.269147 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.269148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:27.269244 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:27.269840 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:27.269849 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:27.271454 (+ 1605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:27.273341 (+ 1887us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:27.273350 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:27.273352 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:27.273715 (+ 363us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:27.273983 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:27.273984 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:27.273985 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:27.274131 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:27.274446 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:27.274455 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:27.274669 (+ 214us) client_negotiation.cc:769] Sending connection context
0808 05:03:27.274787 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 05:03:27.274950 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":86,"threads_started":1}
I20260808 05:03:27.275635 17347 heartbeater.cc:347] Connected to a master server at 127.11.70.254:36631
I20260808 05:03:27.275746 17347 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:27.275925 17347 heartbeater.cc:511] Master 127.11.70.254:36631 requested a full tablet report, sending...
I20260808 05:03:27.276332 16672 ts_manager.cc:194] Registered new tserver with Master: 77036c97a07e454b9764eb24f32f42dd (127.11.70.195:42305)
I20260808 05:03:27.276736 16672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:35757
I20260808 05:03:27.285724 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[16610](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[16610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:27.310724 17358 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:27.302726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33716 (local address 127.11.70.193:38895)
0808 05:03:27.302915 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:27.302923 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:27.302940 (+ 17us) server_negotiation.cc:407] Connection header received
0808 05:03:27.302968 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:27.302970 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:27.302985 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:27.303055 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:27.303659 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.304379 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.305119 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.305423 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.305476 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:27.307802 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:27.307810 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:27.307810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:27.307817 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:27.309476 (+ 1659us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:27.309797 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:27.309800 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:27.309800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:27.309871 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:27.310119 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:27.310120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:27.310120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:27.310252 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:27.310357 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:27.310526 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 05:03:27.310600 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":114,"threads_started":1}
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[16610](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165407, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:27.319303 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:27.312135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34216 (local address 127.11.70.254:36631)
0808 05:03:27.312198 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:27.312200 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:27.312214 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:03:27.312241 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:27.312242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:27.312252 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:27.312302 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:27.312772 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.313314 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.314126 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:27.314313 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:27.314372 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:27.316680 (+ 2308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:27.316682 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:27.316682 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:27.316691 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:27.317935 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:27.318341 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:27.318342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:27.318343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:27.318410 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:27.318685 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:27.318686 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:27.318686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:27.318854 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:27.318978 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:27.319098 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 05:03:27.319182 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260808 05:03:27.319587 16672 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34216
I20260808 05:03:27.319962 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 16765
I20260808 05:03:27.333527 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 16957
I20260808 05:03:27.351166 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 17153
I20260808 05:03:27.360613 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 16630
2026-08-08T05:03:27Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2135 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[17372](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[17372](info): set up 2 sockets
Aug 08 05:03:27 dist-test-slave-7kzw krb5kdc[17372](info): commencing operation
krb5kdc: starting...
W20260808 05:03:28.588696 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:28 dist-test-slave-7kzw krb5kdc[17372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:28.718155 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:38755
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:38755
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:28.803817 17389 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:28.804060 17389 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:28.804100 17389 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:28.805248 17389 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:28.805315 17389 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:28.805338 17389 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:28.805361 17389 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:28.805390 17389 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:28.806921 17389 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:38755
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:38755
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17389
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:28.807195 17389 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:28.807446 17389 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:28.812393 17396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:28.812440 17400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:28.812402 17397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:28.812726 17389 server_base.cc:1034] running on GCE node
I20260808 05:03:28.812989 17389 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:28.813349 17389 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:28.814534 17389 hybrid_clock.cc:648] HybridClock initialized: now 1786165408814515 us; error 46 us; skew 500 ppm
Aug 08 05:03:28 dist-test-slave-7kzw krb5kdc[17372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165408, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:28.817022 17389 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:28.817374 17389 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:28.817452 17389 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:28.817613 17389 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:28.818738 17389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "9a9097ea830f4a0aa89a43ab7665b823"
format_stamp: "Formatted at 2026-08-08 05:03:28 on dist-test-slave-7kzw"
server_key: "0420f2699e35f7887db0a4dee3cfeaa4"
server_key_iv: "0d3aaac66116e686efb6862dc5c07e44"
server_key_version: "encryptionkey@0"
I20260808 05:03:28.819104 17389 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "9a9097ea830f4a0aa89a43ab7665b823"
format_stamp: "Formatted at 2026-08-08 05:03:28 on dist-test-slave-7kzw"
server_key: "0420f2699e35f7887db0a4dee3cfeaa4"
server_key_iv: "0d3aaac66116e686efb6862dc5c07e44"
server_key_version: "encryptionkey@0"
I20260808 05:03:28.820393 17389 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:28.821074 17407 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:28.821255 17389 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:28.821359 17389 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "9a9097ea830f4a0aa89a43ab7665b823"
format_stamp: "Formatted at 2026-08-08 05:03:28 on dist-test-slave-7kzw"
server_key: "0420f2699e35f7887db0a4dee3cfeaa4"
server_key_iv: "0d3aaac66116e686efb6862dc5c07e44"
server_key_version: "encryptionkey@0"
I20260808 05:03:28.821444 17389 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:28.838757 17389 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:28.840591 17389 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:28.840770 17389 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:28.844964 17389 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:38755
I20260808 05:03:28.844990 17483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:38755 every 8 connection(s)
I20260808 05:03:28.845291 17389 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:28.846418 17484 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:28.848789 17484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823: Bootstrap starting.
I20260808 05:03:28.849444 17484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:28.849699 17484 log.cc:824] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:28.850363 17484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823: No bootstrap required, opened a new log
I20260808 05:03:28.851992 17484 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9097ea830f4a0aa89a43ab7665b823" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38755 } }
I20260808 05:03:28.852130 17484 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:28.852154 17484 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9097ea830f4a0aa89a43ab7665b823, State: Initialized, Role: FOLLOWER
I20260808 05:03:28.852257 17484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9097ea830f4a0aa89a43ab7665b823" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38755 } }
I20260808 05:03:28.852336 17484 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:28.852370 17484 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:28.852447 17484 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:28.853277 17484 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9097ea830f4a0aa89a43ab7665b823" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38755 } }
I20260808 05:03:28.853406 17484 leader_election.cc:302] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9a9097ea830f4a0aa89a43ab7665b823; no voters:
I20260808 05:03:28.853583 17484 leader_election.cc:288] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:28.853641 17487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:28.853855 17484 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:28.853878 17487 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [term 1 LEADER]: Becoming Leader. State: Replica: 9a9097ea830f4a0aa89a43ab7665b823, State: Running, Role: LEADER
I20260808 05:03:28.853982 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 17389
I20260808 05:03:28.853992 17487 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9097ea830f4a0aa89a43ab7665b823" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38755 } }
I20260808 05:03:28.854094 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:28.854323 11547 external_mini_cluster.cc:1428] Setting key 2e0ad843b41fdda2579a8ef4c9e5c08e
I20260808 05:03:28.854398 17488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9a9097ea830f4a0aa89a43ab7665b823" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9097ea830f4a0aa89a43ab7665b823" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38755 } } }
I20260808 05:03:28.854532 17488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:28.854714 17489 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9a9097ea830f4a0aa89a43ab7665b823. Latest consensus state: current_term: 1 leader_uuid: "9a9097ea830f4a0aa89a43ab7665b823" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9a9097ea830f4a0aa89a43ab7665b823" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38755 } } }
I20260808 05:03:28.854841 17489 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:28.855028 17496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:28.855626 17496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:28.857316 17496 catalog_manager.cc:1347] Generated new cluster ID: ac659b1645a742239d38711c3f1dc6f5
I20260808 05:03:28.857375 17496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:03:28 dist-test-slave-7kzw krb5kdc[17372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165408, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:28.866325 17503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:28.855018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51470 (local address 127.11.70.254:38755)
0808 05:03:28.855437 (+ 419us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:28.855447 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:28.855488 (+ 41us) server_negotiation.cc:407] Connection header received
0808 05:03:28.855653 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:28.855660 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:28.855724 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:28.856434 (+ 710us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:28.856763 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:28.859214 (+ 2451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:28.859996 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:28.860433 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:28.860559 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:28.862945 (+ 2386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:28.862949 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:28.862949 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:28.862962 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:28.864713 (+ 1751us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:28.865106 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:28.865109 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:28.865110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:28.865210 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:28.865436 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:28.865437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:28.865437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:28.865688 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:28.865863 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:28.865960 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 05:03:28.866107 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":89,"threads_started":1}
I20260808 05:03:28.868647 17496 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:28.869328 17496 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:28.872570 17496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823: Generated new TSK 0
I20260808 05:03:28.872768 17496 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:28.905404 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38755
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:28.990262 17515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:28.990456 17515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:28.990505 17515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:28.992448 17515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:28.992498 17515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:28.992527 17515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:28.993983 17515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:28.994158 17515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:28.994328 17515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:28.999356 17520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:28.999457 17515 server_base.cc:1034] running on GCE node
W20260808 05:03:28.999332 17521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:28.999342 17527 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:28.999781 17515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:29.000051 17515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:29.001217 17515 hybrid_clock.cc:648] HybridClock initialized: now 1786165409001193 us; error 44 us; skew 500 ppm
Aug 08 05:03:29 dist-test-slave-7kzw krb5kdc[17372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:29.003866 17515 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:29.004220 17515 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:29.004297 17515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:29.004449 17515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:29.005520 17515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "908b54cf2a9a4171bdaebca4f4fd5af5"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "0c50b3cd806c620c2edc626c8e450aac"
server_key_iv: "b98095e6dc3d2a32df6e65937bf5319f"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.005892 17515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "908b54cf2a9a4171bdaebca4f4fd5af5"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "0c50b3cd806c620c2edc626c8e450aac"
server_key_iv: "b98095e6dc3d2a32df6e65937bf5319f"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.007347 17515 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:29.008093 17536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.008280 17515 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.008373 17515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "908b54cf2a9a4171bdaebca4f4fd5af5"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "0c50b3cd806c620c2edc626c8e450aac"
server_key_iv: "b98095e6dc3d2a32df6e65937bf5319f"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.008455 17515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:29.023797 17515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:29.025811 17515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:29.025969 17515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:29.026196 17515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:29.026589 17515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:29.026645 17515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.026688 17515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:29.026715 17515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.032790 17515 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:43511
I20260808 05:03:29.032825 17696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:43511 every 8 connection(s)
I20260808 05:03:29.033099 17515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:03:29 dist-test-slave-7kzw krb5kdc[17372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:29.041590 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 17515
I20260808 05:03:29.041716 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:29.041909 11547 external_mini_cluster.cc:1428] Setting key 267a99e7aa46482604f64846a46f2086
I20260808 05:03:29.043051 17503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.033893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:60159 (local address 127.11.70.254:38755)
0808 05:03:29.033982 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.033985 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.034169 (+ 184us) server_negotiation.cc:407] Connection header received
0808 05:03:29.034761 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.034762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.034774 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.034837 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:29.035791 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.036312 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.037303 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.037528 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.037616 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.039637 (+ 2021us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:29.039639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:29.039639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:29.039647 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:29.041218 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:29.041835 (+ 617us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:29.041837 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:29.041837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:29.041906 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:29.042248 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:29.042249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:29.042249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:29.042404 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:29.042497 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.042896 (+ 399us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.042974 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:03:29.043334 17700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.033852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38755 (local address 127.11.70.193:60159)
0808 05:03:29.034045 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:29.034081 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:29.034644 (+ 563us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:29.034906 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:29.034911 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:29.035168 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:29.035654 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.035658 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.036415 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.036417 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.037206 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.037208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.037630 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.037632 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.037761 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.038165 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:29.038174 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:29.039536 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:29.041336 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:29.041344 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:29.041346 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:29.041683 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:29.042004 (+ 321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:29.042004 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:29.042005 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:29.042173 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:29.042577 (+ 404us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:29.042586 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:29.042745 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 05:03:29.042872 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 05:03:29.043046 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":99,"threads_started":1}
I20260808 05:03:29.043895 17697 heartbeater.cc:347] Connected to a master server at 127.11.70.254:38755
I20260808 05:03:29.043989 17697 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:29.044168 17697 heartbeater.cc:511] Master 127.11.70.254:38755 requested a full tablet report, sending...
I20260808 05:03:29.044677 17432 ts_manager.cc:194] Registered new tserver with Master: 908b54cf2a9a4171bdaebca4f4fd5af5 (127.11.70.193:43511)
I20260808 05:03:29.045277 17432 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:60159
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:29.067559 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38755
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:29.151197 17704 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:29.151441 17704 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:29.151482 17704 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:29.152603 17704 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:29.152678 17704 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:29.152724 17704 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:29.154359 17704 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17704
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:29.154652 17704 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:29.154886 17704 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:29.159825 17711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:29.159901 17712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:29.159822 17714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:29.160413 17704 server_base.cc:1034] running on GCE node
I20260808 05:03:29.160629 17704 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:29.160878 17704 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:29.162039 17704 hybrid_clock.cc:648] HybridClock initialized: now 1786165409162035 us; error 36 us; skew 500 ppm
Aug 08 05:03:29 dist-test-slave-7kzw krb5kdc[17372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:29.164741 17704 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:29.165081 17704 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:29.165165 17704 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:29.165318 17704 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:29.166342 17704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "ddfc1d361cd04afaab5d2414e61f3337"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "3432ef533e970f478407a85013ee33af"
server_key_iv: "06b7dc65bf0f0074251e14fc2cbd6e8a"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.166760 17704 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "ddfc1d361cd04afaab5d2414e61f3337"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "3432ef533e970f478407a85013ee33af"
server_key_iv: "06b7dc65bf0f0074251e14fc2cbd6e8a"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.168082 17704 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:29.168799 17721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.168975 17704 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:29.169085 17704 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "ddfc1d361cd04afaab5d2414e61f3337"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "3432ef533e970f478407a85013ee33af"
server_key_iv: "06b7dc65bf0f0074251e14fc2cbd6e8a"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.169175 17704 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:29.181074 17704 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:29.183389 17704 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:29.183550 17704 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:29.183776 17704 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:29.184120 17704 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:29.184187 17704 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.184227 17704 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:29.184255 17704 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.190330 17704 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:43119
I20260808 05:03:29.190376 17889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:43119 every 8 connection(s)
I20260808 05:03:29.190645 17704 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:29.192521 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 17704
I20260808 05:03:29.192653 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:29.192845 11547 external_mini_cluster.cc:1428] Setting key 1e18c57914bd256dae2d827a39c41985
Aug 08 05:03:29 dist-test-slave-7kzw krb5kdc[17372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:29.200795 17503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.191355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:36641 (local address 127.11.70.254:38755)
0808 05:03:29.191428 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.191430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.191640 (+ 210us) server_negotiation.cc:407] Connection header received
0808 05:03:29.192097 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.192098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.192108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.192187 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:29.193294 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.193913 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.195041 (+ 1128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.195280 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.195362 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.197621 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:29.197623 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:29.197623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:29.197631 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:29.199379 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:29.199791 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:29.199792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:29.199792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:29.199863 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:29.200107 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:29.200108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:29.200109 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:29.200269 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:29.200344 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.200591 (+ 247us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.200689 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:03:29.200824 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.191328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38755 (local address 127.11.70.194:36641)
0808 05:03:29.191501 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:29.191543 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:29.192017 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:29.192247 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:29.192251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:29.192523 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:29.193184 (+ 661us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.193191 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.194015 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.194016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.194934 (+ 918us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.194937 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.195372 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.195373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.195498 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.196076 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:29.196084 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:29.197511 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:29.199472 (+ 1961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:29.199479 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:29.199481 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:29.199702 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:29.199936 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:29.199937 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:29.199937 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:29.200037 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:29.200334 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:29.200339 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:29.200450 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 05:03:29.200529 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:03:29.200645 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
I20260808 05:03:29.201443 17890 heartbeater.cc:347] Connected to a master server at 127.11.70.254:38755
I20260808 05:03:29.201563 17890 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:29.201732 17890 heartbeater.cc:511] Master 127.11.70.254:38755 requested a full tablet report, sending...
I20260808 05:03:29.202160 17432 ts_manager.cc:194] Registered new tserver with Master: ddfc1d361cd04afaab5d2414e61f3337 (127.11.70.194:43119)
I20260808 05:03:29.202723 17432 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:36641
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:29.222209 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38755
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:44511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:29.305328 17895 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:29.305532 17895 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:29.305557 17895 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:29.306727 17895 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:29.306770 17895 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:29.306824 17895 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:29.308329 17895 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38755
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17895
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:29.308580 17895 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:29.308815 17895 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:29.314019 17908 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:29.313990 17905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:29.314088 17904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:29.314347 17895 server_base.cc:1034] running on GCE node
I20260808 05:03:29.314584 17895 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:29.314832 17895 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:29.316009 17895 hybrid_clock.cc:648] HybridClock initialized: now 1786165409315989 us; error 38 us; skew 500 ppm
Aug 08 05:03:29 dist-test-slave-7kzw krb5kdc[17372](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:29.318670 17895 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:29.318969 17895 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:29.319012 17895 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:29.319103 17895 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:29.320075 17895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "d5545dbc8000403a95c05fff013efdbc"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "247be18a34fc00b16adebc408dd319e4"
server_key_iv: "6d4110dcf7c0c38d0c5b5531a4abb8e1"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.320381 17895 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "d5545dbc8000403a95c05fff013efdbc"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "247be18a34fc00b16adebc408dd319e4"
server_key_iv: "6d4110dcf7c0c38d0c5b5531a4abb8e1"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.321602 17895 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:29.322268 17917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.322496 17895 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:29.322602 17895 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "d5545dbc8000403a95c05fff013efdbc"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "247be18a34fc00b16adebc408dd319e4"
server_key_iv: "6d4110dcf7c0c38d0c5b5531a4abb8e1"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.322682 17895 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:29.345906 17895 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:29.348104 17895 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:29.348272 17895 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:29.348519 17895 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:29.348865 17895 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:29.348922 17895 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.348968 17895 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:29.348995 17895 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.355193 17895 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:37235
I20260808 05:03:29.355240 18087 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:37235 every 8 connection(s)
I20260808 05:03:29.355557 17895 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:03:29.358052 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 17895
I20260808 05:03:29.358166 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:29.358378 11547 external_mini_cluster.cc:1428] Setting key 0e51cba01ed62a9b40f4966aa7f933ce
Aug 08 05:03:29 dist-test-slave-7kzw krb5kdc[17372](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165409, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:29.364375 17503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.356260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:43303 (local address 127.11.70.254:38755)
0808 05:03:29.356311 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.356314 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.356576 (+ 262us) server_negotiation.cc:407] Connection header received
0808 05:03:29.357022 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.357023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.357033 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.357084 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:29.358003 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.358705 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.359735 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.359942 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.360030 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.362001 (+ 1971us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:29.362002 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:29.362002 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:29.362009 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:29.363250 (+ 1241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:29.363603 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:29.363604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:29.363604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:29.363654 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:29.363873 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:29.363873 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:29.363873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:29.363965 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:29.364015 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.364249 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.364311 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:03:29.364555 18092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.356267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38755 (local address 127.11.70.195:43303)
0808 05:03:29.356432 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:29.356477 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:29.356941 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:29.357132 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:29.357135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:29.357391 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:29.357914 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.357920 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.358833 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.358836 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.359623 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.359625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.360043 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.360044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.360182 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.360593 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:29.360601 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:29.361920 (+ 1319us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:29.363320 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:29.363326 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:29.363328 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:29.363538 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:29.363712 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:29.363713 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:29.363713 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:29.363819 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:29.364020 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:29.364024 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:29.364129 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 05:03:29.364211 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 05:03:29.364324 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
I20260808 05:03:29.364969 18089 heartbeater.cc:347] Connected to a master server at 127.11.70.254:38755
I20260808 05:03:29.365064 18089 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:29.365173 18089 heartbeater.cc:511] Master 127.11.70.254:38755 requested a full tablet report, sending...
I20260808 05:03:29.365518 17432 ts_manager.cc:194] Registered new tserver with Master: d5545dbc8000403a95c05fff013efdbc (127.11.70.195:37235)
I20260808 05:03:29.365847 17432 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:43303
I20260808 05:03:29.369889 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:03:29.377363 17503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.371160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51472 (local address 127.11.70.254:38755)
0808 05:03:29.371226 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.371227 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.371317 (+ 90us) server_negotiation.cc:407] Connection header received
0808 05:03:29.371334 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.371335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.371343 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.371399 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:29.371985 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.372502 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.373399 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.373596 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.373672 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.374882 (+ 1210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:29.374883 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:29.374883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:29.374890 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:29.376117 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:29.376516 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:29.376517 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:29.376517 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:29.376581 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:29.376819 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:29.376819 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:29.376820 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:29.376967 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:29.377073 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.377188 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.377263 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:03:29.379043 17432 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51472:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:29.380530 17432 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:29.387039 18105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.382817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:43511 (local address 127.0.0.1:53534)
0808 05:03:29.383413 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:29.383421 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:29.383465 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:29.383764 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:29.383765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:29.383767 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:29.383797 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.383798 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.385019 (+ 1221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.385020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.385921 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.385924 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.386717 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.386718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.386798 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.386812 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:03:29.386911 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 05:03:29.386964 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"mutex_wait_us":3,"thread_start_us":87,"threads_started":1}
I20260808 05:03:29.387058 18109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.383076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53534 (local address 127.11.70.193:43511)
0808 05:03:29.383310 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.383314 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.383524 (+ 210us) server_negotiation.cc:407] Connection header received
0808 05:03:29.383571 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.383573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.383591 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.383673 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:29.383883 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.384899 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.386008 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.386618 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.386705 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.386766 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.386930 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.386975 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":119,"threads_started":1}
I20260808 05:03:29.387305 18108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.383060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50168 (local address 127.11.70.195:37235)
0808 05:03:29.383235 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.383240 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.383311 (+ 71us) server_negotiation.cc:407] Connection header received
0808 05:03:29.383401 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.383403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.383421 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.383565 (+ 144us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:29.383788 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.384486 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.386078 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.386826 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.386900 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.386955 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.387156 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.387194 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":109,"threads_started":1}
I20260808 05:03:29.387197 18102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.382797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:43119 (local address 127.0.0.1:43448)
0808 05:03:29.382963 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:29.383001 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:29.383070 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:29.383409 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:29.383412 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:29.383415 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:29.383477 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.383478 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.384780 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.384781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.385975 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.385978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.386933 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.386934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.387014 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.387018 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:29.387051 (+ 33us) client_negotiation.cc:240] Negotiation successful
0808 05:03:29.387099 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"mutex_wait_us":9,"thread_start_us":49,"threads_started":1}
I20260808 05:03:29.387470 18103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.382797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:37235 (local address 127.0.0.1:50168)
0808 05:03:29.383255 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:29.383265 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:29.383325 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:29.383653 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:29.383654 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:29.383656 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:29.383709 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.383711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.384592 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.384593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.385975 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.385978 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.386984 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.386985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.387038 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.387043 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:03:29.387089 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:03:29.387118 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":437,"mutex_wait_us":64,"thread_start_us":94,"threads_started":1}
I20260808 05:03:29.387509 18106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.382908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43448 (local address 127.11.70.194:43119)
0808 05:03:29.383237 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.383242 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.383252 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:29.383295 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.383297 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.383314 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.383387 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:29.383562 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.384678 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.386079 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.386826 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.387287 (+ 461us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.387357 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.387386 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.387430 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":90,"threads_started":1}
I20260808 05:03:29.388180 17598 tablet_service.cc:1467] Processing CreateTablet for tablet 54a4b9aace3347a3ae5fef898c38b18c (DEFAULT_TABLE table=test-table [id=f3c92fd51a0245139b97ebe31692d80a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:29.388180 17801 tablet_service.cc:1467] Processing CreateTablet for tablet 54a4b9aace3347a3ae5fef898c38b18c (DEFAULT_TABLE table=test-table [id=f3c92fd51a0245139b97ebe31692d80a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:29.388206 17991 tablet_service.cc:1467] Processing CreateTablet for tablet 54a4b9aace3347a3ae5fef898c38b18c (DEFAULT_TABLE table=test-table [id=f3c92fd51a0245139b97ebe31692d80a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:29.388532 17598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54a4b9aace3347a3ae5fef898c38b18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:29.388530 17991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54a4b9aace3347a3ae5fef898c38b18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:29.388530 17801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54a4b9aace3347a3ae5fef898c38b18c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:29.391233 18110 tablet_bootstrap.cc:492] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5: Bootstrap starting.
I20260808 05:03:29.391831 18111 tablet_bootstrap.cc:492] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: Bootstrap starting.
I20260808 05:03:29.391947 18110 tablet_bootstrap.cc:654] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:29.392076 18112 tablet_bootstrap.cc:492] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: Bootstrap starting.
I20260808 05:03:29.392611 18111 tablet_bootstrap.cc:654] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:29.392650 18112 tablet_bootstrap.cc:654] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:29.392714 18110 log.cc:824] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:29.393203 18111 log.cc:824] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:29.393339 18112 log.cc:824] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:29.393605 18110 tablet_bootstrap.cc:492] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5: No bootstrap required, opened a new log
I20260808 05:03:29.393708 18110 ts_tablet_manager.cc:1397] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:03:29.394021 18111 tablet_bootstrap.cc:492] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: No bootstrap required, opened a new log
I20260808 05:03:29.394114 18111 ts_tablet_manager.cc:1397] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:29.394999 18112 tablet_bootstrap.cc:492] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: No bootstrap required, opened a new log
I20260808 05:03:29.395083 18112 ts_tablet_manager.cc:1397] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:03:29.395519 18110 raft_consensus.cc:348] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } }
I20260808 05:03:29.395687 18110 raft_consensus.cc:374] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:29.395753 18110 raft_consensus.cc:729] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 908b54cf2a9a4171bdaebca4f4fd5af5, State: Initialized, Role: FOLLOWER
I20260808 05:03:29.395884 18110 consensus_queue.cc:260] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } }
I20260808 05:03:29.396206 17697 heartbeater.cc:503] Master 127.11.70.254:38755 was elected leader, sending a full tablet report...
I20260808 05:03:29.396204 18110 ts_tablet_manager.cc:1428] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:03:29.396196 18111 raft_consensus.cc:348] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } }
I20260808 05:03:29.396368 18111 raft_consensus.cc:374] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:29.396415 18111 raft_consensus.cc:729] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ddfc1d361cd04afaab5d2414e61f3337, State: Initialized, Role: FOLLOWER
I20260808 05:03:29.396523 18111 consensus_queue.cc:260] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } }
I20260808 05:03:29.396797 17890 heartbeater.cc:503] Master 127.11.70.254:38755 was elected leader, sending a full tablet report...
I20260808 05:03:29.396798 18111 ts_tablet_manager.cc:1428] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:03:29.397583 18112 raft_consensus.cc:348] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } }
I20260808 05:03:29.397739 18112 raft_consensus.cc:374] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:29.397806 18112 raft_consensus.cc:729] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5545dbc8000403a95c05fff013efdbc, State: Initialized, Role: FOLLOWER
I20260808 05:03:29.397919 18112 consensus_queue.cc:260] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } }
I20260808 05:03:29.398216 18112 ts_tablet_manager.cc:1428] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:03:29.398347 18089 heartbeater.cc:503] Master 127.11.70.254:38755 was elected leader, sending a full tablet report...
W20260808 05:03:29.441115 17891 tablet.cc:2369] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:03:29.533897 17698 tablet.cc:2369] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:03:29.606166 18091 tablet.cc:2369] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:29.659762 18120 raft_consensus.cc:482] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:29.659945 18120 raft_consensus.cc:504] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } }
I20260808 05:03:29.660383 18120 leader_election.cc:288] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5545dbc8000403a95c05fff013efdbc (127.11.70.195:37235), 908b54cf2a9a4171bdaebca4f4fd5af5 (127.11.70.193:43511)
I20260808 05:03:29.664685 18122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.660620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:37235 (local address 127.11.70.194:35357)
0808 05:03:29.660810 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:29.660819 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:29.660903 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:29.661063 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:29.661064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:29.661065 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:29.661140 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.661141 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.662068 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.662070 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.663508 (+ 1438us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.663511 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.664387 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.664387 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.664459 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.664461 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:03:29.664520 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:03:29.664577 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":106,"threads_started":1}
I20260808 05:03:29.664697 18108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.660678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:35357 (local address 127.11.70.195:37235)
0808 05:03:29.660733 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.660735 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.660893 (+ 158us) server_negotiation.cc:407] Connection header received
0808 05:03:29.660972 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.660973 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.660984 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.661032 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:29.661245 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.661947 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.663714 (+ 1767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.664274 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.664324 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.664333 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.664550 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.664603 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:03:29.664695 17892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.660588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:43511 (local address 127.11.70.194:37297)
0808 05:03:29.660649 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:29.660662 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:29.660708 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:29.660875 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:29.660876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:29.660877 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:29.660969 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.660972 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.661993 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.661995 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.663450 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:29.663454 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.664344 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.664345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:29.664457 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.664460 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:29.664539 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:03:29.664577 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":67}
I20260808 05:03:29.665004 18109 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.660679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:37297 (local address 127.11.70.193:43511)
0808 05:03:29.660738 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.660740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.660749 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:29.660779 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.660780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.660790 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.660870 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:29.661062 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.661891 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.663594 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.664236 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.664316 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.664328 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.664857 (+ 529us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.664912 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:03:29.665269 18020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54a4b9aace3347a3ae5fef898c38b18c" candidate_uuid: "ddfc1d361cd04afaab5d2414e61f3337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5545dbc8000403a95c05fff013efdbc" is_pre_election: true
I20260808 05:03:29.665444 18020 raft_consensus.cc:2454] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfc1d361cd04afaab5d2414e61f3337 in term 0.
I20260808 05:03:29.665599 17631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54a4b9aace3347a3ae5fef898c38b18c" candidate_uuid: "ddfc1d361cd04afaab5d2414e61f3337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" is_pre_election: true
I20260808 05:03:29.665697 17727 leader_election.cc:302] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5545dbc8000403a95c05fff013efdbc, ddfc1d361cd04afaab5d2414e61f3337; no voters:
I20260808 05:03:29.665795 17631 raft_consensus.cc:2454] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ddfc1d361cd04afaab5d2414e61f3337 in term 0.
I20260808 05:03:29.665839 18120 raft_consensus.cc:2781] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:29.665896 18120 raft_consensus.cc:482] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:29.665954 18120 raft_consensus.cc:3037] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:29.666911 18120 raft_consensus.cc:504] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } }
I20260808 05:03:29.667057 18120 leader_election.cc:288] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [CANDIDATE]: Term 1 election: Requested vote from peers d5545dbc8000403a95c05fff013efdbc (127.11.70.195:37235), 908b54cf2a9a4171bdaebca4f4fd5af5 (127.11.70.193:43511)
I20260808 05:03:29.667209 18020 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54a4b9aace3347a3ae5fef898c38b18c" candidate_uuid: "ddfc1d361cd04afaab5d2414e61f3337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5545dbc8000403a95c05fff013efdbc"
I20260808 05:03:29.667312 18020 raft_consensus.cc:3037] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:29.667393 17631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54a4b9aace3347a3ae5fef898c38b18c" candidate_uuid: "ddfc1d361cd04afaab5d2414e61f3337" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5"
I20260808 05:03:29.667469 17631 raft_consensus.cc:3037] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:29.668263 18020 raft_consensus.cc:2454] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfc1d361cd04afaab5d2414e61f3337 in term 1.
I20260808 05:03:29.668368 17631 raft_consensus.cc:2454] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ddfc1d361cd04afaab5d2414e61f3337 in term 1.
I20260808 05:03:29.668545 17724 leader_election.cc:302] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 908b54cf2a9a4171bdaebca4f4fd5af5, ddfc1d361cd04afaab5d2414e61f3337; no voters:
I20260808 05:03:29.668684 18120 raft_consensus.cc:2781] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:29.668829 18120 raft_consensus.cc:686] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 1 LEADER]: Becoming Leader. State: Replica: ddfc1d361cd04afaab5d2414e61f3337, State: Running, Role: LEADER
I20260808 05:03:29.669070 18120 consensus_queue.cc:237] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } }
I20260808 05:03:29.670535 17431 catalog_manager.cc:5495] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 reported cstate change: term changed from 0 to 1, leader changed from <none> to ddfc1d361cd04afaab5d2414e61f3337 (127.11.70.194). New cstate: current_term: 1 leader_uuid: "ddfc1d361cd04afaab5d2414e61f3337" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ddfc1d361cd04afaab5d2414e61f3337" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 } health_report { overall_health: UNKNOWN } } }
I20260808 05:03:29.738858 18106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.736209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43462 (local address 127.11.70.194:43119)
0808 05:03:29.736279 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.736281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.736290 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:29.736332 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.736333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.736352 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.736415 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:29.736755 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.737233 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.737986 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:29.738198 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:29.738257 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:29.738412 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:29.738529 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:29.738592 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.738659 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.738720 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:03:29.740787 18020 raft_consensus.cc:1261] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [term 1 FOLLOWER]: Refusing update from remote peer ddfc1d361cd04afaab5d2414e61f3337: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:29.740787 17631 raft_consensus.cc:1261] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [term 1 FOLLOWER]: Refusing update from remote peer ddfc1d361cd04afaab5d2414e61f3337: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:29.741178 18120 consensus_queue.cc:1035] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "908b54cf2a9a4171bdaebca4f4fd5af5" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:29.741346 18123 consensus_queue.cc:1035] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5545dbc8000403a95c05fff013efdbc" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 37235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:29.744308 18128 mvcc.cc:205] Tried to move back new op lower bound from 7316133518295334912 to 7316133518005194752. Current Snapshot: MvccSnapshot[applied={T|T < 7316133518295334912}]
I20260808 05:03:29.745225 18126 mvcc.cc:205] Tried to move back new op lower bound from 7316133518295334912 to 7316133518005194752. Current Snapshot: MvccSnapshot[applied={T|T < 7316133518295334912 or (T in {7316133518295334912})}]
I20260808 05:03:29.745285 18130 mvcc.cc:205] Tried to move back new op lower bound from 7316133518295334912 to 7316133518005194752. Current Snapshot: MvccSnapshot[applied={T|T < 7316133518295334912}]
I20260808 05:03:29.746682 17431 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51472:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:29.746819 17431 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:51472:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:29.747711 17431 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9a9097ea830f4a0aa89a43ab7665b823: Sending DeleteTablet for 3 replicas of tablet 54a4b9aace3347a3ae5fef898c38b18c
I20260808 05:03:29.748029 17801 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a4b9aace3347a3ae5fef898c38b18c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:29 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:43448
I20260808 05:03:29.748039 17991 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a4b9aace3347a3ae5fef898c38b18c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:29 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:50168
I20260808 05:03:29.748042 17990 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a4b9aace3347a3ae5fef898c38b18c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:29 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:50168
I20260808 05:03:29.748291 18137 tablet_replica.cc:330] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: stopping tablet replica
I20260808 05:03:29.748397 18137 raft_consensus.cc:2229] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:29.748445 17598 tablet_service.cc:1514] Processing DeleteTablet for tablet 54a4b9aace3347a3ae5fef898c38b18c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:29 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:53534
I20260808 05:03:29.748500 18137 raft_consensus.cc:2258] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:29.748791 18139 tablet_replica.cc:330] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5: stopping tablet replica
I20260808 05:03:29.748894 18139 raft_consensus.cc:2229] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:29.748999 18139 raft_consensus.cc:2258] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:29.749056 18137 ts_tablet_manager.cc:1905] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:29.749311 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 17515
I20260808 05:03:29.749498 18139 ts_tablet_manager.cc:1905] T 54a4b9aace3347a3ae5fef898c38b18c P 908b54cf2a9a4171bdaebca4f4fd5af5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:29.751889 18137 ts_tablet_manager.cc:1918] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:29.752038 18137 log.cc:1196] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/54a4b9aace3347a3ae5fef898c38b18c
I20260808 05:03:29.752488 18137 ts_tablet_manager.cc:1939] T 54a4b9aace3347a3ae5fef898c38b18c P ddfc1d361cd04afaab5d2414e61f3337: Deleting consensus metadata
I20260808 05:03:29.756119 18138 tablet_replica.cc:330] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: stopping tablet replica
I20260808 05:03:29.756237 18138 raft_consensus.cc:2229] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:29.756393 18138 raft_consensus.cc:2258] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:29.756819 18138 ts_tablet_manager.cc:1905] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:29.758103 17410 catalog_manager.cc:4841] TS ddfc1d361cd04afaab5d2414e61f3337 (127.11.70.194:43119): tablet 54a4b9aace3347a3ae5fef898c38b18c (table test-table [id=f3c92fd51a0245139b97ebe31692d80a]) successfully deleted
I20260808 05:03:29.758502 18138 ts_tablet_manager.cc:1918] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:29.758656 18138 log.cc:1196] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/54a4b9aace3347a3ae5fef898c38b18c
I20260808 05:03:29.759003 18138 ts_tablet_manager.cc:1939] T 54a4b9aace3347a3ae5fef898c38b18c P d5545dbc8000403a95c05fff013efdbc: Deleting consensus metadata
I20260808 05:03:29.759500 17414 catalog_manager.cc:4841] TS d5545dbc8000403a95c05fff013efdbc (127.11.70.195:37235): tablet 54a4b9aace3347a3ae5fef898c38b18c (table test-table [id=f3c92fd51a0245139b97ebe31692d80a]) successfully deleted
W20260808 05:03:29.759701 17414 catalog_manager.cc:4808] TS d5545dbc8000403a95c05fff013efdbc (127.11.70.195:37235): delete failed for tablet 54a4b9aace3347a3ae5fef898c38b18c because the tablet was not found. No further retry: Not found: Tablet not found: 54a4b9aace3347a3ae5fef898c38b18c
W20260808 05:03:29.764676 17409 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:43511 (error 108)
I20260808 05:03:29.765020 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 17704
I20260808 05:03:29.765645 18103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.765106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:43511 (local address 127.0.0.1:53544)
0808 05:03:29.765551 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:29.765602 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:43511: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":421}
W20260808 05:03:29.766683 17409 catalog_manager.cc:4584] TS 908b54cf2a9a4171bdaebca4f4fd5af5 (127.11.70.193:43511): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 54a4b9aace3347a3ae5fef898c38b18c: Network error: Client connection negotiation failed: client connection to 127.11.70.193:43511: connect: Connection refused (error 111)
I20260808 05:03:29.779805 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 17895
I20260808 05:03:29.786628 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 17389
2026-08-08T05:03:29Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2425 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T05:03:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:29Z Disabled control of system clock
I20260808 05:03:29.819706 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:39923
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:34255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:39923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 05:03:29.902547 18149 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:29.902751 18149 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:29.902773 18149 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:29.904436 18149 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:29.904484 18149 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:29.904496 18149 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:29.904510 18149 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:29.904522 18149 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:29.905815 18149 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:34255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:39923
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:39923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18149
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:29.906010 18149 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:29.906250 18149 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:29.911183 18162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:29.911212 18159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:29.911217 18158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:29.911510 18149 server_base.cc:1034] running on GCE node
I20260808 05:03:29.911779 18149 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:29.912060 18149 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:29.913239 18149 hybrid_clock.cc:648] HybridClock initialized: now 1786165409913222 us; error 30 us; skew 500 ppm
I20260808 05:03:29.914572 18149 webserver.cc:460] Webserver started at http://127.11.70.254:34883/ using document root <none> and password file <none>
I20260808 05:03:29.914839 18149 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:29.914915 18149 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:29.915113 18149 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:29.916181 18149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "7ad48e238d42414ea3f6729c42103ced"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "700f7b148de2b3c589ef7912aeae296d"
server_key_iv: "827bb183d8e6123ea1ca95c06adedfe7"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.916555 18149 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "7ad48e238d42414ea3f6729c42103ced"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "700f7b148de2b3c589ef7912aeae296d"
server_key_iv: "827bb183d8e6123ea1ca95c06adedfe7"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.917985 18149 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:29.918872 18172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:29.919062 18149 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:29.919175 18149 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "7ad48e238d42414ea3f6729c42103ced"
format_stamp: "Formatted at 2026-08-08 05:03:29 on dist-test-slave-7kzw"
server_key: "700f7b148de2b3c589ef7912aeae296d"
server_key_iv: "827bb183d8e6123ea1ca95c06adedfe7"
server_key_version: "encryptionkey@0"
I20260808 05:03:29.919266 18149 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:29.922626 18149 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:29.922888 18149 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:29.923039 18149 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:29.927119 18149 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:39923
I20260808 05:03:29.927150 18247 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:39923 every 8 connection(s)
I20260808 05:03:29.927515 18149 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:29.928186 18250 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:29.931047 18250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced: Bootstrap starting.
I20260808 05:03:29.931624 18250 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:29.931929 18250 log.cc:824] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:29.932636 18250 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced: No bootstrap required, opened a new log
I20260808 05:03:29.934037 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 18149
I20260808 05:03:29.934139 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:29.934329 11547 external_mini_cluster.cc:1428] Setting key 5a25513ea7c899efa3c5533884840347
I20260808 05:03:29.934580 18250 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad48e238d42414ea3f6729c42103ced" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39923 } }
I20260808 05:03:29.934736 18250 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:29.934800 18250 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad48e238d42414ea3f6729c42103ced, State: Initialized, Role: FOLLOWER
I20260808 05:03:29.934964 18250 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad48e238d42414ea3f6729c42103ced" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39923 } }
I20260808 05:03:29.935066 18250 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:29.935130 18250 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:29.935194 18250 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:29.935907 18250 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad48e238d42414ea3f6729c42103ced" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39923 } }
I20260808 05:03:29.936039 18250 leader_election.cc:302] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7ad48e238d42414ea3f6729c42103ced; no voters:
I20260808 05:03:29.936201 18250 leader_election.cc:288] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:29.936230 18259 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:29.936420 18259 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [term 1 LEADER]: Becoming Leader. State: Replica: 7ad48e238d42414ea3f6729c42103ced, State: Running, Role: LEADER
I20260808 05:03:29.936534 18250 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:29.936571 18259 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad48e238d42414ea3f6729c42103ced" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39923 } }
I20260808 05:03:29.936801 18257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:29.934889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59096 (local address 127.11.70.254:39923)
0808 05:03:29.935136 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:29.935144 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:29.935185 (+ 41us) server_negotiation.cc:407] Connection header received
0808 05:03:29.935299 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:29.935306 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:29.935352 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:29.935504 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:29.936155 (+ 651us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:29.936159 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:29.936159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:29.936163 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:29.936213 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:29.936237 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:29.936319 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:29.936388 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 05:03:29.936449 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":108,"threads_started":1}
I20260808 05:03:29.936928 18259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7ad48e238d42414ea3f6729c42103ced. Latest consensus state: current_term: 1 leader_uuid: "7ad48e238d42414ea3f6729c42103ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad48e238d42414ea3f6729c42103ced" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39923 } } }
I20260808 05:03:29.937023 18259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:29.937103 18264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7ad48e238d42414ea3f6729c42103ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7ad48e238d42414ea3f6729c42103ced" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39923 } } }
I20260808 05:03:29.937213 18264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:29.938038 18267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:29.938616 18267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:29.940119 18267 catalog_manager.cc:1347] Generated new cluster ID: 14efcc0334a74be2831744a1c9225c2f
I20260808 05:03:29.940181 18267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:29.960389 18267 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:29.960597 18267 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:29.973420 18267 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced: Generated new TSK 0
I20260808 05:03:29.973635 18267 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:03:29.979074 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39923
--builtin_ntp_servers=127.11.70.212:34255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 05:03:30.070986 18285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:30.071198 18285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:30.071221 18285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:30.072443 18285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:30.072487 18285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:30.072512 18285 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:30.073869 18285 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:34255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:30.074116 18285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:30.074420 18285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:30.079655 18293 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:30.079668 18290 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:30.079668 18291 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:30.079916 18285 server_base.cc:1034] running on GCE node
I20260808 05:03:30.080166 18285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:30.080443 18285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:30.081607 18285 hybrid_clock.cc:648] HybridClock initialized: now 1786165410081585 us; error 39 us; skew 500 ppm
I20260808 05:03:30.083307 18285 webserver.cc:460] Webserver started at http://127.11.70.193:36017/ using document root <none> and password file <none>
I20260808 05:03:30.083591 18285 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:30.083642 18285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:30.083774 18285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:30.084969 18285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "d3c7c1fa633d778acf267bbb63aed135"
server_key_iv: "e84a3505290cefd0125d9be361b5e5ff"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.085343 18285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "d3c7c1fa633d778acf267bbb63aed135"
server_key_iv: "e84a3505290cefd0125d9be361b5e5ff"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.086822 18285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:03:30.087587 18303 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.087745 18285 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:30.087834 18285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "d3c7c1fa633d778acf267bbb63aed135"
server_key_iv: "e84a3505290cefd0125d9be361b5e5ff"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.087913 18285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:30.091282 18285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:30.091547 18285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:30.091692 18285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:30.091913 18285 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:30.092238 18285 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:30.092296 18285 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.092338 18285 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:30.092365 18285 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.098150 18285 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:35217
I20260808 05:03:30.098258 18470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:35217 every 8 connection(s)
I20260808 05:03:30.098623 18285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:30.101531 18257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.099403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:41537 (local address 127.11.70.254:39923)
0808 05:03:30.099471 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.099473 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.099697 (+ 224us) server_negotiation.cc:407] Connection header received
0808 05:03:30.100142 (+ 445us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.100143 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.100149 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.100220 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.101332 (+ 1112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.101333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.101334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.101338 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.101354 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.101358 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.101405 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.101463 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.101476 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:03:30.101790 18475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.099356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39923 (local address 127.11.70.193:41537)
0808 05:03:30.099563 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.099602 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.100049 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.100268 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.100271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.100279 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:30.101185 (+ 906us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:03:30.101186 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:30.101214 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:03:30.101242 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:30.101403 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:30.101405 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:30.101408 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:30.101457 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:03:30.101503 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":112,"threads_started":1}
I20260808 05:03:30.102346 18473 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39923
I20260808 05:03:30.102427 18473 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:30.102645 18473 heartbeater.cc:511] Master 127.11.70.254:39923 requested a full tablet report, sending...
I20260808 05:03:30.103166 18195 ts_manager.cc:194] Registered new tserver with Master: f9b0d709fb1f4c62a4b2ca2804a6f174 (127.11.70.193:35217)
I20260808 05:03:30.105158 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 18285
I20260808 05:03:30.105247 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:30.105491 11547 external_mini_cluster.cc:1428] Setting key f9edebd049175da0e50c51914984fb1f
I20260808 05:03:30.106353 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39923
--builtin_ntp_servers=127.11.70.212:34255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 05:03:30.192553 18476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:30.192767 18476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:30.192790 18476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:30.193887 18476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:30.193921 18476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:30.193946 18476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:30.195304 18476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:34255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18476
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:30.195489 18476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:30.195727 18476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:30.200878 18486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:30.201018 18482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:30.201129 18476 server_base.cc:1034] running on GCE node
W20260808 05:03:30.200878 18481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:30.201517 18476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:30.201807 18476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:30.202970 18476 hybrid_clock.cc:648] HybridClock initialized: now 1786165410202967 us; error 36 us; skew 500 ppm
I20260808 05:03:30.204237 18476 webserver.cc:460] Webserver started at http://127.11.70.194:35215/ using document root <none> and password file <none>
I20260808 05:03:30.204481 18476 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:30.204552 18476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:30.204697 18476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:30.205788 18476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "ed04edb98a564b009434584f2dd2ecdb"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "6ff9e2d50519372b64409131eb12d135"
server_key_iv: "7192e256ae9f001ec616daed4f3403f9"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.206215 18476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "ed04edb98a564b009434584f2dd2ecdb"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "6ff9e2d50519372b64409131eb12d135"
server_key_iv: "7192e256ae9f001ec616daed4f3403f9"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.207666 18476 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:30.208436 18493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.208616 18476 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:30.208722 18476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "ed04edb98a564b009434584f2dd2ecdb"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "6ff9e2d50519372b64409131eb12d135"
server_key_iv: "7192e256ae9f001ec616daed4f3403f9"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.208808 18476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:30.212319 18476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:30.212584 18476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:30.212726 18476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:30.212936 18476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:30.213244 18476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:30.213299 18476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.213338 18476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:30.213366 18476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.219254 18476 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:39287
I20260808 05:03:30.219298 18659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:39287 every 8 connection(s)
I20260808 05:03:30.219604 18476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:30.222157 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 18476
I20260808 05:03:30.222275 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:30.222512 11547 external_mini_cluster.cc:1428] Setting key 45d3c8ff2f331d014e6abb1bc138fb1f
I20260808 05:03:30.222784 18257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.220311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:46245 (local address 127.11.70.254:39923)
0808 05:03:30.220360 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.220362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.220588 (+ 226us) server_negotiation.cc:407] Connection header received
0808 05:03:30.221018 (+ 430us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.221019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.221025 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.221086 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.222496 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.222498 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.222498 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.222503 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.222529 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.222533 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.222608 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.222697 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.222711 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:30.223032 18665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.220270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39923 (local address 127.11.70.194:46245)
0808 05:03:30.220462 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.220501 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.220935 (+ 434us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.221135 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.221138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.221147 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:30.222275 (+ 1128us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:03:30.222275 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:30.222316 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:03:30.222353 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:30.222606 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:30.222614 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:30.222617 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:30.222709 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 05:03:30.222770 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":97,"threads_started":1}
I20260808 05:03:30.223500 18660 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39923
I20260808 05:03:30.223590 18660 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:30.223623 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39923
--builtin_ntp_servers=127.11.70.212:34255
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260808 05:03:30.223807 18660 heartbeater.cc:511] Master 127.11.70.254:39923 requested a full tablet report, sending...
I20260808 05:03:30.224207 18195 ts_manager.cc:194] Registered new tserver with Master: ed04edb98a564b009434584f2dd2ecdb (127.11.70.194:39287)
W20260808 05:03:30.308789 18667 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:30.309039 18667 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:30.309067 18667 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:30.310209 18667 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:30.310250 18667 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:30.310276 18667 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:30.311761 18667 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:34255
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18667
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:30.312005 18667 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:30.312300 18667 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:30.317440 18673 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:30.317577 18675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:30.317577 18678 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:30.317906 18667 server_base.cc:1034] running on GCE node
I20260808 05:03:30.318099 18667 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:30.318365 18667 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:30.319531 18667 hybrid_clock.cc:648] HybridClock initialized: now 1786165410319523 us; error 37 us; skew 500 ppm
I20260808 05:03:30.320784 18667 webserver.cc:460] Webserver started at http://127.11.70.195:34197/ using document root <none> and password file <none>
I20260808 05:03:30.321040 18667 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:30.321112 18667 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:30.321272 18667 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:30.322346 18667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "37ea8f91294c4824ba6b9b91d4966ab4"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "6af4ca1d48143363d89a4b9902f7fcb1"
server_key_iv: "cf3265e82e7896f4eabcdec5b35c4253"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.322744 18667 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "37ea8f91294c4824ba6b9b91d4966ab4"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "6af4ca1d48143363d89a4b9902f7fcb1"
server_key_iv: "cf3265e82e7896f4eabcdec5b35c4253"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.323966 18667 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:30.324733 18684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.324971 18667 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:30.325058 18667 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "37ea8f91294c4824ba6b9b91d4966ab4"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "6af4ca1d48143363d89a4b9902f7fcb1"
server_key_iv: "cf3265e82e7896f4eabcdec5b35c4253"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.325114 18667 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:30.328523 18667 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:30.328747 18667 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:30.328841 18667 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:30.328991 18667 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:30.329293 18667 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:30.329329 18667 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.329349 18667 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:30.329362 18667 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.335278 18667 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:40285
I20260808 05:03:30.335325 18844 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:40285 every 8 connection(s)
I20260808 05:03:30.335630 18667 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:03:30.339182 18257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.336322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:35411 (local address 127.11.70.254:39923)
0808 05:03:30.336370 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.336372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.336740 (+ 368us) server_negotiation.cc:407] Connection header received
0808 05:03:30.337307 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.337309 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.337316 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.337396 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.338893 (+ 1497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.338894 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.338894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.338900 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.338917 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.338922 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.339009 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.339085 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.339102 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:30.339381 18852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.336307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39923 (local address 127.11.70.195:35411)
0808 05:03:30.336602 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.336648 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.337186 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.337468 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.337472 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.337481 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:30.338724 (+ 1243us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:03:30.338724 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:30.338753 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:03:30.338780 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:30.338995 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:30.339002 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:30.339005 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:30.339095 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:03:30.339157 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":222,"thread_start_us":114,"threads_started":1}
I20260808 05:03:30.339517 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 18667
I20260808 05:03:30.339633 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:30.339871 11547 external_mini_cluster.cc:1428] Setting key 40dee037623e1949f2b061b328ddd69b
I20260808 05:03:30.339908 18845 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39923
I20260808 05:03:30.340019 18845 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:30.340171 18845 heartbeater.cc:511] Master 127.11.70.254:39923 requested a full tablet report, sending...
I20260808 05:03:30.340584 18194 ts_manager.cc:194] Registered new tserver with Master: 37ea8f91294c4824ba6b9b91d4966ab4 (127.11.70.195:40285)
I20260808 05:03:30.351707 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:03:30.354341 18257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.353157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59104 (local address 127.11.70.254:39923)
0808 05:03:30.353228 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.353231 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.353378 (+ 147us) server_negotiation.cc:407] Connection header received
0808 05:03:30.353454 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.353455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.353460 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.353525 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.354085 (+ 560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.354086 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.354087 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.354091 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.354107 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.354111 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.354190 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.354251 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.354267 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:03:30.356046 18194 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:30.357577 18194 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:30.361441 18862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.359841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:40285 (local address 127.0.0.1:42248)
0808 05:03:30.360003 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.360045 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.360097 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.360398 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.360404 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.360411 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:30.360849 (+ 438us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:03:30.360849 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:30.360865 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:03:30.360887 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:30.361274 (+ 387us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:30.361280 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:30.361283 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:30.361345 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:03:30.361357 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":94,"threads_started":1}
I20260808 05:03:30.361586 18866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.359963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36030 (local address 127.11.70.194:39287)
0808 05:03:30.360158 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.360164 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.360241 (+ 77us) server_negotiation.cc:407] Connection header received
0808 05:03:30.360303 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.360306 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.360316 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.360415 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.361251 (+ 836us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.361261 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.361261 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.361267 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.361302 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.361330 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.361391 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.361458 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.361477 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":83,"threads_started":1}
I20260808 05:03:30.361781 18865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.359896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42248 (local address 127.11.70.195:40285)
0808 05:03:30.360259 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.360263 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.360273 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:30.360297 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.360299 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.360309 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.360359 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.361107 (+ 748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.361111 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.361111 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.361115 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.361158 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.361175 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.361279 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.361666 (+ 387us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.361683 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":88,"threads_started":1}
I20260808 05:03:30.361804 18870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.359845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:39287 (local address 127.0.0.1:36030)
0808 05:03:30.360175 (+ 330us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.360187 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.360246 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.360733 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.360734 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.360737 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:30.361135 (+ 398us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:03:30.361135 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:30.361142 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:03:30.361159 (+ 17us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:30.361396 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:30.361396 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:30.361397 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:03:30.361437 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 05:03:30.361451 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":312,"thread_start_us":51,"threads_started":1}
I20260808 05:03:30.362274 18863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.360041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:35217 (local address 127.0.0.1:59490)
0808 05:03:30.360842 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.360850 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.360928 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.361334 (+ 406us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.361335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.361338 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:30.361863 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:03:30.361864 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:30.361872 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:03:30.361887 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:30.362139 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:30.362140 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:30.362140 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 05:03:30.362191 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 05:03:30.362204 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":784,"thread_start_us":75,"threads_started":1}
I20260808 05:03:30.362327 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.360209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59490 (local address 127.11.70.193:35217)
0808 05:03:30.360665 (+ 456us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.360669 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.360928 (+ 259us) server_negotiation.cc:407] Connection header received
0808 05:03:30.360980 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.360982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.360991 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.361086 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.361987 (+ 901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.361994 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.361994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.361999 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.362031 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.362059 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.362111 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.362226 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.362245 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":419,"thread_start_us":89,"threads_started":1}
I20260808 05:03:30.362421 18749 tablet_service.cc:1467] Processing CreateTablet for tablet 47379c059bfe4885ac61db668393e090 (DEFAULT_TABLE table=test-table [id=e7ae754c2d6e47ab9306738d9426fe0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:30.362564 18561 tablet_service.cc:1467] Processing CreateTablet for tablet 47379c059bfe4885ac61db668393e090 (DEFAULT_TABLE table=test-table [id=e7ae754c2d6e47ab9306738d9426fe0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:30.362825 18749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47379c059bfe4885ac61db668393e090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:30.362944 18561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47379c059bfe4885ac61db668393e090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:30.362932 18381 tablet_service.cc:1467] Processing CreateTablet for tablet 47379c059bfe4885ac61db668393e090 (DEFAULT_TABLE table=test-table [id=e7ae754c2d6e47ab9306738d9426fe0a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:30.363250 18381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 47379c059bfe4885ac61db668393e090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:30.365453 18872 tablet_bootstrap.cc:492] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: Bootstrap starting.
I20260808 05:03:30.366120 18873 tablet_bootstrap.cc:492] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: Bootstrap starting.
I20260808 05:03:30.366278 18872 tablet_bootstrap.cc:654] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:30.366686 18872 log.cc:824] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:30.366839 18873 tablet_bootstrap.cc:654] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:30.367074 18874 tablet_bootstrap.cc:492] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174: Bootstrap starting.
I20260808 05:03:30.367192 18873 log.cc:824] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:30.367588 18872 tablet_bootstrap.cc:492] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: No bootstrap required, opened a new log
I20260808 05:03:30.367672 18872 ts_tablet_manager.cc:1397] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:30.367717 18874 tablet_bootstrap.cc:654] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:30.368072 18874 log.cc:824] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:30.368464 18873 tablet_bootstrap.cc:492] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: No bootstrap required, opened a new log
I20260808 05:03:30.368546 18873 ts_tablet_manager.cc:1397] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:03:30.368824 18874 tablet_bootstrap.cc:492] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174: No bootstrap required, opened a new log
I20260808 05:03:30.368892 18874 ts_tablet_manager.cc:1397] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:30.369886 18872 raft_consensus.cc:348] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } }
I20260808 05:03:30.370039 18872 raft_consensus.cc:374] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:30.370085 18872 raft_consensus.cc:729] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed04edb98a564b009434584f2dd2ecdb, State: Initialized, Role: FOLLOWER
I20260808 05:03:30.370206 18872 consensus_queue.cc:260] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } }
I20260808 05:03:30.370513 18872 ts_tablet_manager.cc:1428] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:03:30.370524 18660 heartbeater.cc:503] Master 127.11.70.254:39923 was elected leader, sending a full tablet report...
I20260808 05:03:30.371531 18874 raft_consensus.cc:348] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } }
I20260808 05:03:30.371531 18873 raft_consensus.cc:348] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } }
I20260808 05:03:30.371690 18874 raft_consensus.cc:374] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:30.371690 18873 raft_consensus.cc:374] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:30.371737 18873 raft_consensus.cc:729] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37ea8f91294c4824ba6b9b91d4966ab4, State: Initialized, Role: FOLLOWER
I20260808 05:03:30.371737 18874 raft_consensus.cc:729] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9b0d709fb1f4c62a4b2ca2804a6f174, State: Initialized, Role: FOLLOWER
I20260808 05:03:30.371855 18873 consensus_queue.cc:260] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } }
I20260808 05:03:30.371855 18874 consensus_queue.cc:260] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } }
I20260808 05:03:30.372109 18874 ts_tablet_manager.cc:1428] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:03:30.372109 18873 ts_tablet_manager.cc:1428] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260808 05:03:30.372166 18473 heartbeater.cc:503] Master 127.11.70.254:39923 was elected leader, sending a full tablet report...
I20260808 05:03:30.372225 18845 heartbeater.cc:503] Master 127.11.70.254:39923 was elected leader, sending a full tablet report...
I20260808 05:03:30.419230 18884 raft_consensus.cc:482] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:30.419364 18884 raft_consensus.cc:504] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } }
I20260808 05:03:30.419670 18884 leader_election.cc:288] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed04edb98a564b009434584f2dd2ecdb (127.11.70.194:39287), f9b0d709fb1f4c62a4b2ca2804a6f174 (127.11.70.193:35217)
I20260808 05:03:30.421227 18852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.419942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:39287 (local address 127.11.70.195:57407)
0808 05:03:30.420034 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.420048 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.420103 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.420313 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.420314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.420316 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:30.420884 (+ 568us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:03:30.420884 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:30.420892 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:03:30.420903 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:30.421089 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:30.421090 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:30.421090 (+ 0us) client_negotiation.cc:769] Sending connection context
0808 05:03:30.421141 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 05:03:30.421157 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260808 05:03:30.421240 18866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.419998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:57407 (local address 127.11.70.194:39287)
0808 05:03:30.420049 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.420051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.420164 (+ 113us) server_negotiation.cc:407] Connection header received
0808 05:03:30.420194 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.420195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.420202 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.420254 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.420990 (+ 736us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.420992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.420993 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.420997 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.421020 (+ 23us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.421025 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.421092 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.421142 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.421157 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:03:30.421592 18871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.420178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:34633 (local address 127.11.70.193:35217)
0808 05:03:30.420243 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.420245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.420372 (+ 127us) server_negotiation.cc:407] Connection header received
0808 05:03:30.420404 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.420405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.420412 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.420476 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.421207 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.421209 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.421210 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.421216 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.421236 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.421242 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.421302 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.421505 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.421525 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:03:30.421605 18587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47379c059bfe4885ac61db668393e090" candidate_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed04edb98a564b009434584f2dd2ecdb" is_pre_election: true
I20260808 05:03:30.421665 18887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.420099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:35217 (local address 127.11.70.195:34633)
0808 05:03:30.420287 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.420297 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.420350 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.420523 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.420524 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.420527 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:30.421085 (+ 558us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:03:30.421086 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:30.421092 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:03:30.421104 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:30.421435 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:30.421436 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:30.421437 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:03:30.421493 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 05:03:30.421508 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":103,"threads_started":1}
I20260808 05:03:30.421792 18587 raft_consensus.cc:2454] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37ea8f91294c4824ba6b9b91d4966ab4 in term 0.
I20260808 05:03:30.422096 18686 leader_election.cc:302] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ea8f91294c4824ba6b9b91d4966ab4, ed04edb98a564b009434584f2dd2ecdb; no voters:
I20260808 05:03:30.422216 18406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47379c059bfe4885ac61db668393e090" candidate_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" is_pre_election: true
I20260808 05:03:30.422242 18884 raft_consensus.cc:2781] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:30.422325 18884 raft_consensus.cc:482] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:30.422353 18884 raft_consensus.cc:3037] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:30.422374 18406 raft_consensus.cc:2454] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37ea8f91294c4824ba6b9b91d4966ab4 in term 0.
I20260808 05:03:30.423295 18884 raft_consensus.cc:504] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } }
I20260808 05:03:30.423449 18884 leader_election.cc:288] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [CANDIDATE]: Term 1 election: Requested vote from peers ed04edb98a564b009434584f2dd2ecdb (127.11.70.194:39287), f9b0d709fb1f4c62a4b2ca2804a6f174 (127.11.70.193:35217)
I20260808 05:03:30.423669 18406 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47379c059bfe4885ac61db668393e090" candidate_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174"
I20260808 05:03:30.423663 18587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47379c059bfe4885ac61db668393e090" candidate_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed04edb98a564b009434584f2dd2ecdb"
I20260808 05:03:30.423753 18587 raft_consensus.cc:3037] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:30.423750 18406 raft_consensus.cc:3037] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:30.424721 18406 raft_consensus.cc:2454] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ea8f91294c4824ba6b9b91d4966ab4 in term 1.
I20260808 05:03:30.424731 18587 raft_consensus.cc:2454] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37ea8f91294c4824ba6b9b91d4966ab4 in term 1.
I20260808 05:03:30.424929 18686 leader_election.cc:302] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37ea8f91294c4824ba6b9b91d4966ab4, ed04edb98a564b009434584f2dd2ecdb; no voters:
I20260808 05:03:30.425026 18884 raft_consensus.cc:2781] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:30.425200 18884 raft_consensus.cc:686] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 1 LEADER]: Becoming Leader. State: Replica: 37ea8f91294c4824ba6b9b91d4966ab4, State: Running, Role: LEADER
I20260808 05:03:30.425318 18884 consensus_queue.cc:237] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } }
I20260808 05:03:30.426167 18194 catalog_manager.cc:5495] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 37ea8f91294c4824ba6b9b91d4966ab4 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37ea8f91294c4824ba6b9b91d4966ab4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40285 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 } health_report { overall_health: UNKNOWN } } }
I20260808 05:03:30.438026 18865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.436892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42262 (local address 127.11.70.195:40285)
0808 05:03:30.436937 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.436939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.436986 (+ 47us) server_negotiation.cc:407] Connection header received
0808 05:03:30.437100 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.437101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.437122 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.437190 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.437834 (+ 644us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.437835 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.437835 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.437839 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.437855 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.437858 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.437912 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.437945 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.437956 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:30.439810 18587 raft_consensus.cc:1261] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [term 1 FOLLOWER]: Refusing update from remote peer 37ea8f91294c4824ba6b9b91d4966ab4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:30.439832 18406 raft_consensus.cc:1261] T 47379c059bfe4885ac61db668393e090 P f9b0d709fb1f4c62a4b2ca2804a6f174 [term 1 FOLLOWER]: Refusing update from remote peer 37ea8f91294c4824ba6b9b91d4966ab4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:30.440205 18890 consensus_queue.cc:1035] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f9b0d709fb1f4c62a4b2ca2804a6f174" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 35217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:30.440379 18884 consensus_queue.cc:1035] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed04edb98a564b009434584f2dd2ecdb" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39287 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:30.442888 18896 mvcc.cc:205] Tried to move back new op lower bound from 7316133521158983680 to 7316133521102925824. Current Snapshot: MvccSnapshot[applied={T|T < 7316133521158983680}]
I20260808 05:03:30.443714 18894 mvcc.cc:205] Tried to move back new op lower bound from 7316133521158983680 to 7316133521102925824. Current Snapshot: MvccSnapshot[applied={T|T < 7316133521158983680 or (T in {7316133521158983680})}]
I20260808 05:03:30.444857 18194 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:30.444952 18194 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:30.445775 18194 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7ad48e238d42414ea3f6729c42103ced: Sending DeleteTablet for 3 replicas of tablet 47379c059bfe4885ac61db668393e090
I20260808 05:03:30.446108 18749 tablet_service.cc:1514] Processing DeleteTablet for tablet 47379c059bfe4885ac61db668393e090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:30 UTC) from {username='slave'} at 127.0.0.1:42248
I20260808 05:03:30.446172 18561 tablet_service.cc:1514] Processing DeleteTablet for tablet 47379c059bfe4885ac61db668393e090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:30 UTC) from {username='slave'} at 127.0.0.1:36030
I20260808 05:03:30.446223 18381 tablet_service.cc:1514] Processing DeleteTablet for tablet 47379c059bfe4885ac61db668393e090 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:30 UTC) from {username='slave'} at 127.0.0.1:59490
I20260808 05:03:30.446432 18909 tablet_replica.cc:330] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: stopping tablet replica
I20260808 05:03:30.446545 18908 tablet_replica.cc:330] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: stopping tablet replica
I20260808 05:03:30.446640 18909 raft_consensus.cc:2229] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:30.446702 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 18285
I20260808 05:03:30.446647 18908 raft_consensus.cc:2229] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:30.447440 18909 raft_consensus.cc:2258] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:30.456748 18908 raft_consensus.cc:2258] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:30.456770 18909 ts_tablet_manager.cc:1905] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:30.457276 18908 ts_tablet_manager.cc:1905] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:30.458928 18908 ts_tablet_manager.cc:1918] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:30.459022 18908 log.cc:1196] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/47379c059bfe4885ac61db668393e090
I20260808 05:03:30.459187 18909 ts_tablet_manager.cc:1918] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:30.459319 18908 ts_tablet_manager.cc:1939] T 47379c059bfe4885ac61db668393e090 P 37ea8f91294c4824ba6b9b91d4966ab4: Deleting consensus metadata
I20260808 05:03:30.459400 18909 log.cc:1196] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/47379c059bfe4885ac61db668393e090
I20260808 05:03:30.459739 18909 ts_tablet_manager.cc:1939] T 47379c059bfe4885ac61db668393e090 P ed04edb98a564b009434584f2dd2ecdb: Deleting consensus metadata
I20260808 05:03:30.459753 18177 catalog_manager.cc:4841] TS 37ea8f91294c4824ba6b9b91d4966ab4 (127.11.70.195:40285): tablet 47379c059bfe4885ac61db668393e090 (table test-table [id=e7ae754c2d6e47ab9306738d9426fe0a]) successfully deleted
I20260808 05:03:30.460263 18174 catalog_manager.cc:4841] TS ed04edb98a564b009434584f2dd2ecdb (127.11.70.194:39287): tablet 47379c059bfe4885ac61db668393e090 (table test-table [id=e7ae754c2d6e47ab9306738d9426fe0a]) successfully deleted
W20260808 05:03:30.461786 18174 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:35217 (error 108)
I20260808 05:03:30.462102 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 18476
I20260808 05:03:30.462716 18863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.462148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:35217 (local address 127.0.0.1:59498)
0808 05:03:30.462625 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.462676 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:35217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453}
W20260808 05:03:30.462877 18174 catalog_manager.cc:4584] TS f9b0d709fb1f4c62a4b2ca2804a6f174 (127.11.70.193:35217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 47379c059bfe4885ac61db668393e090: Network error: Client connection negotiation failed: client connection to 127.11.70.193:35217: connect: Connection refused (error 111)
I20260808 05:03:30.472851 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 18667
I20260808 05:03:30.484380 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 18149
2026-08-08T05:03:30Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (697 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 05:03:30.508941 11547 mini_oidc.cc:152] Starting JWKS server
I20260808 05:03:30.510155 11547 webserver.cc:460] Webserver started at https://127.0.0.1:46625/ using document root <none> and password file <none>
I20260808 05:03:30.510293 11547 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 05:03:30.510531 11547 webserver.cc:460] Webserver started at http://127.0.0.1:40605/ using document root <none> and password file <none>
2026-08-08T05:03:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:30Z Disabled control of system clock
I20260808 05:03:30.519909 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:40721
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:41985
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:40721
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46625/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/testchainca.cert with env {}
W20260808 05:03:30.602315 18922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:30.602542 18922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:30.602566 18922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:30.603752 18922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:30.603794 18922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:30.603807 18922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:30.603820 18922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:30.603832 18922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:03:30.603873 18922 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:03:30.603899 18922 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46625/jwks.json
I20260808 05:03:30.605454 18922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41985
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:40721
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:40721
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46625/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18922
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:30.605703 18922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:30.605947 18922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:30.610983 18934 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:30.611052 18930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:30.611179 18922 server_base.cc:1034] running on GCE node
W20260808 05:03:30.610986 18932 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:30.611655 18922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:30.611955 18922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:30.613130 18922 hybrid_clock.cc:648] HybridClock initialized: now 1786165410613111 us; error 49 us; skew 500 ppm
I20260808 05:03:30.614395 18922 webserver.cc:460] Webserver started at http://127.11.70.254:42705/ using document root <none> and password file <none>
I20260808 05:03:30.614718 18922 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:30.614773 18922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:30.614863 18922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:30.615859 18922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "05484279698f4d64b7dbfbfd4a0873a9"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "b745bc6921fe06ac2f6f64a2081370d5"
server_key_iv: "e51abbcb83f613ce5171bf8692fa5475"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.616165 18922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "05484279698f4d64b7dbfbfd4a0873a9"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "b745bc6921fe06ac2f6f64a2081370d5"
server_key_iv: "e51abbcb83f613ce5171bf8692fa5475"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.617362 18922 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:30.618028 18946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.618196 18922 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:30.618268 18922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "05484279698f4d64b7dbfbfd4a0873a9"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "b745bc6921fe06ac2f6f64a2081370d5"
server_key_iv: "e51abbcb83f613ce5171bf8692fa5475"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.618321 18922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:30.644668 18922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:30.644940 18922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:30.645046 18922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:30.649223 18922 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:40721
I20260808 05:03:30.649281 19021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:40721 every 8 connection(s)
I20260808 05:03:30.649624 18922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:30.650818 19022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:30.653141 19022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9: Bootstrap starting.
I20260808 05:03:30.653817 19022 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:30.654084 19022 log.cc:824] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:30.654764 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 18922
I20260808 05:03:30.654886 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:30.654963 19022 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9: No bootstrap required, opened a new log
I20260808 05:03:30.655105 11547 external_mini_cluster.cc:1428] Setting key 9d6f96430bd42c8605454e8822395aff
I20260808 05:03:30.657651 19022 raft_consensus.cc:348] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05484279698f4d64b7dbfbfd4a0873a9" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40721 } }
I20260808 05:03:30.657840 19022 raft_consensus.cc:374] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:30.657883 19022 raft_consensus.cc:729] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 05484279698f4d64b7dbfbfd4a0873a9, State: Initialized, Role: FOLLOWER
I20260808 05:03:30.658008 19022 consensus_queue.cc:260] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05484279698f4d64b7dbfbfd4a0873a9" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40721 } }
I20260808 05:03:30.658085 19022 raft_consensus.cc:388] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:30.658133 19022 raft_consensus.cc:482] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:30.658180 19022 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:30.658905 19022 raft_consensus.cc:504] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05484279698f4d64b7dbfbfd4a0873a9" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40721 } }
I20260808 05:03:30.659034 19022 leader_election.cc:302] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 05484279698f4d64b7dbfbfd4a0873a9; no voters:
I20260808 05:03:30.659193 19022 leader_election.cc:288] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:30.659221 19032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:30.659339 19032 raft_consensus.cc:686] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [term 1 LEADER]: Becoming Leader. State: Replica: 05484279698f4d64b7dbfbfd4a0873a9, State: Running, Role: LEADER
I20260808 05:03:30.659500 19022 sys_catalog.cc:564] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:30.659497 19032 consensus_queue.cc:237] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05484279698f4d64b7dbfbfd4a0873a9" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40721 } }
I20260808 05:03:30.661098 19030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.655629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36986 (local address 127.11.70.254:40721)
0808 05:03:30.655863 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.655870 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.655895 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:03:30.656400 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.656407 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.656467 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.656588 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.656832 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.657671 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.658810 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.659376 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.659848 (+ 472us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:30.660296 (+ 448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.660300 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.660301 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.660521 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.660562 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.660578 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.660652 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.660771 (+ 119us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.660870 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":114,"threads_started":1}
I20260808 05:03:30.661464 19035 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 05484279698f4d64b7dbfbfd4a0873a9. Latest consensus state: current_term: 1 leader_uuid: "05484279698f4d64b7dbfbfd4a0873a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05484279698f4d64b7dbfbfd4a0873a9" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40721 } } }
I20260808 05:03:30.661548 19035 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:30.661966 19036 sys_catalog.cc:455] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "05484279698f4d64b7dbfbfd4a0873a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "05484279698f4d64b7dbfbfd4a0873a9" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40721 } } }
I20260808 05:03:30.662043 19036 sys_catalog.cc:458] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:30.662168 19055 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:30.662626 19055 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:30.664057 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:03:30.664391 19055 catalog_manager.cc:1347] Generated new cluster ID: 8c67ba69272c4f998580fd5caa97bab6
I20260808 05:03:30.664433 19055 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:30.675807 19055 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:30.676625 19055 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:30.683682 19055 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 05484279698f4d64b7dbfbfd4a0873a9: Generated new TSK 0
I20260808 05:03:30.683835 19055 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 05:03:30.711366 19071 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 05:03:30.711544 19071 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 05:03:30.711771 19030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.693943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37000 (local address 127.11.70.254:40721)
0808 05:03:30.693991 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.693993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.694137 (+ 144us) server_negotiation.cc:407] Connection header received
0808 05:03:30.694245 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.694246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.694261 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.694323 (+ 62us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:03:30.694562 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.695305 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.696693 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.697080 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.697129 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:30.697479 (+ 350us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:03:30.711478 (+ 13999us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 05:03:30.711689 (+ 211us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37000: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 05:03:30.711848 19030 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37000: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 05:03:30.712328 19069 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:30.693878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40721 (local address 127.0.0.1:37000)
0808 05:03:30.694052 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.694063 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.694161 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.694374 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.694375 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.694377 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:03:30.694445 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:30.694448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.695435 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.695436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:30.696572 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:30.696576 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.697219 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.697221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:30.697300 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:30.697328 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:03:30.711731 (+ 14403us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 05:03:30.711886 (+ 155us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.70.254:40721: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":75,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.11.70.254:40721: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46625/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 05:03:30.712918 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 18922
2026-08-08T05:03:30Z chronyd exiting
I20260808 05:03:30.758440 11547 test_util.cc:175] -----------------------------------------------
I20260808 05:03:30.758594 11547 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165386228479-11547-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (250 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 05:03:30.759388 11547 mini_oidc.cc:152] Starting JWKS server
I20260808 05:03:30.760104 11547 webserver.cc:460] Webserver started at https://127.0.0.1:41799/ using document root <none> and password file <none>
I20260808 05:03:30.760174 11547 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 05:03:30.760354 11547 webserver.cc:460] Webserver started at http://127.0.0.1:45105/ using document root <none> and password file <none>
2026-08-08T05:03:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:30Z Disabled control of system clock
I20260808 05:03:30.769459 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37009
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:37845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:37009
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41799/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/testchainca.cert with env {}
W20260808 05:03:30.851693 19081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:30.851948 19081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:30.851986 19081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:30.853150 19081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:30.853223 19081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:30.853245 19081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:30.853266 19081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:30.853294 19081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:03:30.853324 19081 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:03:30.853351 19081 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:41799/jwks.json
I20260808 05:03:30.855120 19081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:37009
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:41799/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:30.855406 19081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:30.855623 19081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:30.860874 19088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:30.860981 19091 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:30.860883 19089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:30.860965 19081 server_base.cc:1034] running on GCE node
I20260808 05:03:30.861297 19081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:30.861531 19081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:30.862675 19081 hybrid_clock.cc:648] HybridClock initialized: now 1786165410862646 us; error 41 us; skew 500 ppm
I20260808 05:03:30.864102 19081 webserver.cc:460] Webserver started at http://127.11.70.254:45057/ using document root <none> and password file <none>
I20260808 05:03:30.864364 19081 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:30.864411 19081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:30.864580 19081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:30.865609 19081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "4094c2b7f1d74a8b8ddae2484846dfa7"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "51f63196585c2256c7b1d2d0c1f6cf1c"
server_key_iv: "fcb8b4c004d17facfe0da3fb582b9c74"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.866007 19081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "4094c2b7f1d74a8b8ddae2484846dfa7"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "51f63196585c2256c7b1d2d0c1f6cf1c"
server_key_iv: "fcb8b4c004d17facfe0da3fb582b9c74"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.867403 19081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:30.868206 19097 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:30.868399 19081 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:30.868467 19081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "4094c2b7f1d74a8b8ddae2484846dfa7"
format_stamp: "Formatted at 2026-08-08 05:03:30 on dist-test-slave-7kzw"
server_key: "51f63196585c2256c7b1d2d0c1f6cf1c"
server_key_iv: "fcb8b4c004d17facfe0da3fb582b9c74"
server_key_version: "encryptionkey@0"
I20260808 05:03:30.868557 19081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:30.913612 19081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:30.913975 19081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:30.914160 19081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:30.918247 19081 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:37009
I20260808 05:03:30.918316 19167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:37009 every 8 connection(s)
I20260808 05:03:30.918673 19081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:30.919415 19168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:30.922247 19168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7: Bootstrap starting.
I20260808 05:03:30.922904 19168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:30.923202 19168 log.cc:824] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:30.923909 19168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7: No bootstrap required, opened a new log
I20260808 05:03:30.924321 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 19081
I20260808 05:03:30.924412 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:30.924611 11547 external_mini_cluster.cc:1428] Setting key 7bdc1bbc7276087ced9bf8faebdce536
I20260808 05:03:30.926380 19168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4094c2b7f1d74a8b8ddae2484846dfa7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37009 } }
I20260808 05:03:30.926630 19168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:30.926687 19168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4094c2b7f1d74a8b8ddae2484846dfa7, State: Initialized, Role: FOLLOWER
I20260808 05:03:30.926863 19168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4094c2b7f1d74a8b8ddae2484846dfa7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37009 } }
I20260808 05:03:30.926960 19168 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:30.927001 19168 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:30.927053 19168 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:30.927604 19168 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4094c2b7f1d74a8b8ddae2484846dfa7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37009 } }
I20260808 05:03:30.927728 19168 leader_election.cc:302] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4094c2b7f1d74a8b8ddae2484846dfa7; no voters:
I20260808 05:03:30.927893 19168 leader_election.cc:288] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:30.927937 19175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:30.928059 19175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [term 1 LEADER]: Becoming Leader. State: Replica: 4094c2b7f1d74a8b8ddae2484846dfa7, State: Running, Role: LEADER
I20260808 05:03:30.928165 19168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:30.928146 19175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4094c2b7f1d74a8b8ddae2484846dfa7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37009 } }
I20260808 05:03:30.928483 19175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4094c2b7f1d74a8b8ddae2484846dfa7. Latest consensus state: current_term: 1 leader_uuid: "4094c2b7f1d74a8b8ddae2484846dfa7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4094c2b7f1d74a8b8ddae2484846dfa7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37009 } } }
I20260808 05:03:30.928568 19175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:30.928491 19176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4094c2b7f1d74a8b8ddae2484846dfa7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4094c2b7f1d74a8b8ddae2484846dfa7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37009 } } }
I20260808 05:03:30.928740 19176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:30.928803 19184 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:30.929342 19184 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:30.931167 19184 catalog_manager.cc:1347] Generated new cluster ID: 3ce518abfe2a463eb68aeb5e52d09bad
I20260808 05:03:30.931228 19184 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:30.931244 19174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.925122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49408 (local address 127.11.70.254:37009)
0808 05:03:30.925336 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.925344 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.925369 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:03:30.925826 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.925832 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.925888 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.925999 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:30.926269 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.927651 (+ 1382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.928739 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.929317 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.929410 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:30.930456 (+ 1046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:30.930460 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:30.930460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:30.930685 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:30.930755 (+ 70us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:30.930771 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:30.930846 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:30.930952 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 05:03:30.931032 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":98,"threads_started":1}
I20260808 05:03:30.932119 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:03:30.952602 19184 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:30.953143 19184 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:30.957587 19184 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4094c2b7f1d74a8b8ddae2484846dfa7: Generated new TSK 0
I20260808 05:03:30.957784 19184 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 05:03:30.984233 19207 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 05:03:30.984323 19207 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 05:03:30.984627 19174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:30.970363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49416 (local address 127.11.70.254:37009)
0808 05:03:30.970410 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:30.970412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:30.970524 (+ 112us) server_negotiation.cc:407] Connection header received
0808 05:03:30.970625 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:30.970626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:30.970637 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:30.970694 (+ 57us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:03:30.970845 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.971377 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.972552 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.972753 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.972808 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:30.972999 (+ 191us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:03:30.984449 (+ 11450us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41799/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 05:03:30.984568 (+ 119us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49416: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41799/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 05:03:30.984699 19174 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49416: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41799/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260808 05:03:30.984823 19206 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:30.970254 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37009 (local address 127.0.0.1:49416)
0808 05:03:30.970436 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:30.970448 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:30.970541 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:30.970712 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:30.970713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:30.970715 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:03:30.970775 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:30.970778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.971451 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.971452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:30.972477 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:30.972480 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:30.972829 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:30.972830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:30.972898 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:30.972904 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:03:30.984553 (+ 11649us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41799/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 05:03:30.984709 (+ 156us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.70.254:37009: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:41799/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":114,"threads_started":1}
I20260808 05:03:30.985131 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 19081
2026-08-08T05:03:31Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (271 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 05:03:31.030676 11547 mini_oidc.cc:152] Starting JWKS server
I20260808 05:03:31.031395 11547 webserver.cc:460] Webserver started at https://127.0.0.1:43891/ using document root <none> and password file <none>
I20260808 05:03:31.031437 11547 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 05:03:31.031607 11547 webserver.cc:460] Webserver started at http://127.0.0.1:42365/ using document root <none> and password file <none>
2026-08-08T05:03:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:31Z Disabled control of system clock
I20260808 05:03:31.040922 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:35149
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:44609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:35149
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43891/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 05:03:31.125049 19219 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:31.125252 19219 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:31.125273 19219 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:31.126431 19219 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:31.126489 19219 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:31.126503 19219 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:31.126516 19219 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:31.126569 19219 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:03:31.126587 19219 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:03:31.126613 19219 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:43891/jwks.json
I20260808 05:03:31.127987 19219 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:44609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:35149
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:35149
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:43891/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19219
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:31.128242 19219 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:31.128536 19219 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:31.133543 19233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:31.133570 19228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:31.133701 19219 server_base.cc:1034] running on GCE node
W20260808 05:03:31.133538 19229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:31.134035 19219 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:31.134338 19219 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:31.135486 19219 hybrid_clock.cc:648] HybridClock initialized: now 1786165411135491 us; error 63 us; skew 500 ppm
I20260808 05:03:31.136831 19219 webserver.cc:460] Webserver started at http://127.11.70.254:43485/ using document root <none> and password file <none>
I20260808 05:03:31.137070 19219 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:31.137130 19219 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:31.137307 19219 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:31.138355 19219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "fd83278631384132ba5077408b72830e"
format_stamp: "Formatted at 2026-08-08 05:03:31 on dist-test-slave-7kzw"
server_key: "6d9dde716a5f682fa226d147fd71b389"
server_key_iv: "250e1132b26824695948e5b916d03bfb"
server_key_version: "encryptionkey@0"
I20260808 05:03:31.138785 19219 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "fd83278631384132ba5077408b72830e"
format_stamp: "Formatted at 2026-08-08 05:03:31 on dist-test-slave-7kzw"
server_key: "6d9dde716a5f682fa226d147fd71b389"
server_key_iv: "250e1132b26824695948e5b916d03bfb"
server_key_version: "encryptionkey@0"
I20260808 05:03:31.140034 19219 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:31.140738 19242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:31.140919 19219 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:31.141013 19219 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "fd83278631384132ba5077408b72830e"
format_stamp: "Formatted at 2026-08-08 05:03:31 on dist-test-slave-7kzw"
server_key: "6d9dde716a5f682fa226d147fd71b389"
server_key_iv: "250e1132b26824695948e5b916d03bfb"
server_key_version: "encryptionkey@0"
I20260808 05:03:31.141088 19219 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:31.152364 19219 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:31.152658 19219 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:31.152812 19219 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:31.156999 19219 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:35149
I20260808 05:03:31.157076 19322 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:35149 every 8 connection(s)
I20260808 05:03:31.157403 19219 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:31.158162 19325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:31.160969 19325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e: Bootstrap starting.
I20260808 05:03:31.161597 19325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:31.161901 19325 log.cc:824] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:31.162655 19325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e: No bootstrap required, opened a new log
I20260808 05:03:31.164305 19325 raft_consensus.cc:348] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd83278631384132ba5077408b72830e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35149 } }
I20260808 05:03:31.164438 19325 raft_consensus.cc:374] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:31.164460 19325 raft_consensus.cc:729] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fd83278631384132ba5077408b72830e, State: Initialized, Role: FOLLOWER
I20260808 05:03:31.164641 19325 consensus_queue.cc:260] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd83278631384132ba5077408b72830e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35149 } }
I20260808 05:03:31.164706 19325 raft_consensus.cc:388] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:31.164729 19325 raft_consensus.cc:482] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:31.164799 19325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:31.165357 19325 raft_consensus.cc:504] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd83278631384132ba5077408b72830e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35149 } }
I20260808 05:03:31.165392 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 19219
I20260808 05:03:31.165494 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:31.165480 19325 leader_election.cc:302] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fd83278631384132ba5077408b72830e; no voters:
I20260808 05:03:31.165680 19325 leader_election.cc:288] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:31.165704 11547 external_mini_cluster.cc:1428] Setting key 47b7f45b40754205880cfb6dd75b99a3
I20260808 05:03:31.165705 19329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:31.165833 19329 raft_consensus.cc:686] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [term 1 LEADER]: Becoming Leader. State: Replica: fd83278631384132ba5077408b72830e, State: Running, Role: LEADER
I20260808 05:03:31.165927 19329 consensus_queue.cc:237] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd83278631384132ba5077408b72830e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35149 } }
I20260808 05:03:31.165956 19325 sys_catalog.cc:564] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:31.166250 19329 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [sys.catalog]: SysCatalogTable state changed. Reason: New leader fd83278631384132ba5077408b72830e. Latest consensus state: current_term: 1 leader_uuid: "fd83278631384132ba5077408b72830e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd83278631384132ba5077408b72830e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35149 } } }
I20260808 05:03:31.166339 19329 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:31.166253 19331 sys_catalog.cc:455] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fd83278631384132ba5077408b72830e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fd83278631384132ba5077408b72830e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35149 } } }
I20260808 05:03:31.166571 19331 sys_catalog.cc:458] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:31.166930 19339 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:31.167469 19339 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:31.168927 19339 catalog_manager.cc:1347] Generated new cluster ID: 8ea4989777d7412d9c3ec9a9d470165e
I20260808 05:03:31.168982 19339 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:31.172959 19335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:31.166270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32998 (local address 127.11.70.254:35149)
0808 05:03:31.166490 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:31.166499 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:31.167148 (+ 649us) server_negotiation.cc:407] Connection header received
0808 05:03:31.167426 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:31.167435 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:31.167576 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:31.168093 (+ 517us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:31.168198 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.169537 (+ 1339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.170627 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.171294 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.171422 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:31.172113 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:31.172117 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:31.172118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:31.172334 (+ 216us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:31.172386 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:31.172401 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:31.172473 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:31.172540 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 05:03:31.172737 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260808 05:03:31.173760 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:03:31.198316 19339 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:31.199087 19339 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:31.203533 19339 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fd83278631384132ba5077408b72830e: Generated new TSK 0
I20260808 05:03:31.203722 19339 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:03:31.219151 19335 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:31.215376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33004 (local address 127.11.70.254:35149)
0808 05:03:31.215448 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:31.215450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:31.215598 (+ 148us) server_negotiation.cc:407] Connection header received
0808 05:03:31.215658 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:31.215659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:31.215670 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:31.215731 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:03:31.215884 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.216371 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.217540 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.217722 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.217772 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:31.217970 (+ 198us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:03:31.218913 (+ 943us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43891/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 05:03:31.219049 (+ 136us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:33004: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43891/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":45}
W20260808 05:03:31.219218 19365 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:31.215324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:35149 (local address 127.0.0.1:33004)
0808 05:03:31.215517 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:31.215532 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:31.215598 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:31.215747 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:31.215748 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:31.215749 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:03:31.215813 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:31.215815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.216470 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.216471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:31.217455 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:31.217458 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.217801 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.217802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:31.217865 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:31.217871 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:03:31.219017 (+ 1146us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43891/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 05:03:31.219120 (+ 103us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.70.254:35149: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:43891/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":119,"threads_started":1}
I20260808 05:03:31.219430 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 19219
E20260808 05:03:31.234967 19366 webserver.cc:533] Webserver: sslize failed:
E20260808 05:03:31.235097 19366 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T05:03:31Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (233 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T05:03:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:31Z Disabled control of system clock
I20260808 05:03:31.272457 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:42857
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:40145
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:42857
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/testchainca.cert with env {}
W20260808 05:03:31.353703 19371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:31.353914 19371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:31.353936 19371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:31.355134 19371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:31.355190 19371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:31.355214 19371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:31.355228 19371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:31.355240 19371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:03:31.355253 19371 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:03:31.355264 19371 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 05:03:31.356757 19371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40145
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:42857
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:42857
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:31.356951 19371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:31.357106 19371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:03:31.362002 19371 server_base.cc:1034] running on GCE node
W20260808 05:03:31.362030 19380 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:31.361974 19379 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:31.361985 19382 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:31.362509 19371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:31.362829 19371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:31.363996 19371 hybrid_clock.cc:648] HybridClock initialized: now 1786165411363983 us; error 39 us; skew 500 ppm
I20260808 05:03:31.365252 19371 webserver.cc:460] Webserver started at http://127.11.70.254:33189/ using document root <none> and password file <none>
I20260808 05:03:31.365509 19371 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:31.365581 19371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:31.365736 19371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:31.366838 19371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "c84e47ab3fb74b3dac5c197b342a16a0"
format_stamp: "Formatted at 2026-08-08 05:03:31 on dist-test-slave-7kzw"
server_key: "20015ed3dd60f7ec1d47a39ea4a7a069"
server_key_iv: "fd17207b328926e77e60649781c01c76"
server_key_version: "encryptionkey@0"
I20260808 05:03:31.367202 19371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "c84e47ab3fb74b3dac5c197b342a16a0"
format_stamp: "Formatted at 2026-08-08 05:03:31 on dist-test-slave-7kzw"
server_key: "20015ed3dd60f7ec1d47a39ea4a7a069"
server_key_iv: "fd17207b328926e77e60649781c01c76"
server_key_version: "encryptionkey@0"
I20260808 05:03:31.368666 19371 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:31.369414 19392 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:31.369586 19371 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:31.369696 19371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "c84e47ab3fb74b3dac5c197b342a16a0"
format_stamp: "Formatted at 2026-08-08 05:03:31 on dist-test-slave-7kzw"
server_key: "20015ed3dd60f7ec1d47a39ea4a7a069"
server_key_iv: "fd17207b328926e77e60649781c01c76"
server_key_version: "encryptionkey@0"
I20260808 05:03:31.369779 19371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:31.396611 19371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:31.396960 19371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:31.397128 19371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:31.401147 19371 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:42857
I20260808 05:03:31.401191 19464 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:42857 every 8 connection(s)
I20260808 05:03:31.401646 19371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:31.402742 19466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:31.405066 19466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0: Bootstrap starting.
I20260808 05:03:31.405663 19466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:31.405972 19466 log.cc:824] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:31.406718 19466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0: No bootstrap required, opened a new log
I20260808 05:03:31.407120 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 19371
I20260808 05:03:31.407264 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:31.407471 11547 external_mini_cluster.cc:1428] Setting key 0a2b74f9f74addc6376d89b48e8d8a43
I20260808 05:03:31.408962 19466 raft_consensus.cc:348] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84e47ab3fb74b3dac5c197b342a16a0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42857 } }
I20260808 05:03:31.409126 19466 raft_consensus.cc:374] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:31.409183 19466 raft_consensus.cc:729] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84e47ab3fb74b3dac5c197b342a16a0, State: Initialized, Role: FOLLOWER
I20260808 05:03:31.409340 19466 consensus_queue.cc:260] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84e47ab3fb74b3dac5c197b342a16a0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42857 } }
I20260808 05:03:31.409437 19466 raft_consensus.cc:388] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:31.409482 19466 raft_consensus.cc:482] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:31.409535 19466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:31.410056 19466 raft_consensus.cc:504] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84e47ab3fb74b3dac5c197b342a16a0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42857 } }
I20260808 05:03:31.410183 19466 leader_election.cc:302] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c84e47ab3fb74b3dac5c197b342a16a0; no voters:
I20260808 05:03:31.410379 19466 leader_election.cc:288] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:31.410413 19475 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:31.410552 19475 raft_consensus.cc:686] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [term 1 LEADER]: Becoming Leader. State: Replica: c84e47ab3fb74b3dac5c197b342a16a0, State: Running, Role: LEADER
I20260808 05:03:31.410648 19475 consensus_queue.cc:237] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84e47ab3fb74b3dac5c197b342a16a0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42857 } }
I20260808 05:03:31.410678 19466 sys_catalog.cc:564] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:31.410979 19475 sys_catalog.cc:455] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c84e47ab3fb74b3dac5c197b342a16a0. Latest consensus state: current_term: 1 leader_uuid: "c84e47ab3fb74b3dac5c197b342a16a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84e47ab3fb74b3dac5c197b342a16a0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42857 } } }
I20260808 05:03:31.411055 19475 sys_catalog.cc:458] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:31.410991 19477 sys_catalog.cc:455] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c84e47ab3fb74b3dac5c197b342a16a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c84e47ab3fb74b3dac5c197b342a16a0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42857 } } }
I20260808 05:03:31.411103 19477 sys_catalog.cc:458] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0 [sys.catalog]: This master's current role is: LEADER
W20260808 05:03:31.412508 19495 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:03:31.412566 19495 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:03:31.412611 19480 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:31.412779 19480 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:31.414361 19480 catalog_manager.cc:1347] Generated new cluster ID: c887bf37271f481194a84cc01079c597
I20260808 05:03:31.414433 19480 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:31.414646 19473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:31.408071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57936 (local address 127.11.70.254:42857)
0808 05:03:31.408323 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:31.408330 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:31.408354 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:03:31.408943 (+ 589us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:31.408950 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:31.409008 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:31.409148 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:31.409400 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.410951 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.412185 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.412737 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.412886 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:31.413659 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:31.413663 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:31.413664 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:03:31.413930 (+ 266us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:31.413974 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:03:31.413989 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:31.414077 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:31.414145 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 05:03:31.414347 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":98,"threads_started":1}
I20260808 05:03:31.415617 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:03:31.422539 19480 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:31.423025 19480 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:31.430718 19480 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c84e47ab3fb74b3dac5c197b342a16a0: Generated new TSK 0
I20260808 05:03:31.430900 19480 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:03:31.503204 19473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:31.438973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57952 (local address 127.11.70.254:42857)
0808 05:03:31.439022 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:31.439024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:31.439102 (+ 78us) server_negotiation.cc:407] Connection header received
0808 05:03:31.439173 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:31.439174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:31.439184 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:31.439253 (+ 69us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:03:31.439396 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.439863 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.440992 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.441168 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.441218 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:31.441419 (+ 201us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:03:31.502891 (+ 61472us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 05:03:31.503102 (+ 211us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57952: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 05:03:31.503286 19473 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57952: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 05:03:31.503353 19505 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:31.438855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:42857 (local address 127.0.0.1:57952)
0808 05:03:31.439024 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:31.439035 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:31.439102 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:31.439257 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:31.439258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:31.439260 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:03:31.439323 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:31.439325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.439943 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.439944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:31.440903 (+ 959us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:31.440906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:31.441247 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:31.441248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:31.441321 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:31.441326 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:03:31.503068 (+ 61742us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 05:03:31.503220 (+ 152us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.11.70.254:42857: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":105,"threads_started":1}
I20260808 05:03:31.503614 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 19371
2026-08-08T05:03:31Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (265 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (92 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (95 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:31 dist-test-slave-7kzw krb5kdc[19520](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:31 dist-test-slave-7kzw krb5kdc[19520](info): set up 2 sockets
Aug 08 05:03:31 dist-test-slave-7kzw krb5kdc[19520](info): commencing operation
krb5kdc: starting...
W20260808 05:03:32.924352 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.207s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:33.049613 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:42545
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:45651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:42545
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:33.133625 19540 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:33.133821 19540 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:33.133843 19540 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:33.135013 19540 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:33.135056 19540 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:33.135070 19540 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:33.135082 19540 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:33.135134 19540 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:33.136564 19540 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:42545
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:42545
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19540
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:33.136817 19540 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:33.137048 19540 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:33.141981 19548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:33.142045 19550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:33.142004 19546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:33.142448 19540 server_base.cc:1034] running on GCE node
I20260808 05:03:33.142719 19540 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:33.142954 19540 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:33.144093 19540 hybrid_clock.cc:648] HybridClock initialized: now 1786165413144066 us; error 43 us; skew 500 ppm
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.146675 19540 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:33.147042 19540 webserver.cc:460] Webserver started at http://127.11.70.254:36125/ using document root <none> and password file <none>
I20260808 05:03:33.147243 19540 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:33.147297 19540 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:33.147387 19540 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:33.148357 19540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "45724d964f8644d7a53fe544cbf950e4"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "36af1289c6a1dadcd66bc9c11b700379"
server_key_iv: "e9376afa289e1867b9cdf2f3c7c32acd"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.148651 19540 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "45724d964f8644d7a53fe544cbf950e4"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "36af1289c6a1dadcd66bc9c11b700379"
server_key_iv: "e9376afa289e1867b9cdf2f3c7c32acd"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.149905 19540 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:33.150657 19560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.150833 19540 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:33.150943 19540 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "45724d964f8644d7a53fe544cbf950e4"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "36af1289c6a1dadcd66bc9c11b700379"
server_key_iv: "e9376afa289e1867b9cdf2f3c7c32acd"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.151021 19540 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:33.162684 19540 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:33.165021 19540 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:33.165194 19540 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:33.169310 19540 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:42545
I20260808 05:03:33.169350 19644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:42545 every 8 connection(s)
I20260808 05:03:33.169724 19540 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:33.170686 19645 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:33.172940 19645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4: Bootstrap starting.
I20260808 05:03:33.173563 19645 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:33.173879 19645 log.cc:824] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:33.174372 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 19540
I20260808 05:03:33.174503 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:33.174701 19645 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4: No bootstrap required, opened a new log
I20260808 05:03:33.174707 11547 external_mini_cluster.cc:1428] Setting key 1c8538a3ec8bf0f6fc41e3eb315a2953
I20260808 05:03:33.177026 19645 raft_consensus.cc:348] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45724d964f8644d7a53fe544cbf950e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42545 } }
I20260808 05:03:33.177213 19645 raft_consensus.cc:374] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:33.177260 19645 raft_consensus.cc:729] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45724d964f8644d7a53fe544cbf950e4, State: Initialized, Role: FOLLOWER
I20260808 05:03:33.177409 19645 consensus_queue.cc:260] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45724d964f8644d7a53fe544cbf950e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42545 } }
I20260808 05:03:33.177488 19645 raft_consensus.cc:388] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:33.177518 19645 raft_consensus.cc:482] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:33.177561 19645 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:33.178256 19645 raft_consensus.cc:504] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45724d964f8644d7a53fe544cbf950e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42545 } }
I20260808 05:03:33.178370 19645 leader_election.cc:302] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 45724d964f8644d7a53fe544cbf950e4; no voters:
I20260808 05:03:33.178542 19645 leader_election.cc:288] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:33.178608 19654 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:33.178831 19645 sys_catalog.cc:564] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:33.178844 19654 raft_consensus.cc:686] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [term 1 LEADER]: Becoming Leader. State: Replica: 45724d964f8644d7a53fe544cbf950e4, State: Running, Role: LEADER
I20260808 05:03:33.179046 19654 consensus_queue.cc:237] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45724d964f8644d7a53fe544cbf950e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42545 } }
I20260808 05:03:33.179430 19655 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "45724d964f8644d7a53fe544cbf950e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45724d964f8644d7a53fe544cbf950e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42545 } } }
I20260808 05:03:33.179510 19655 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:33.179735 19657 sys_catalog.cc:455] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 45724d964f8644d7a53fe544cbf950e4. Latest consensus state: current_term: 1 leader_uuid: "45724d964f8644d7a53fe544cbf950e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "45724d964f8644d7a53fe544cbf950e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42545 } } }
I20260808 05:03:33.180042 19657 sys_catalog.cc:458] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:33.180218 19665 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:33.180953 19665 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:33.182608 19665 catalog_manager.cc:1347] Generated new cluster ID: c69294f37bda4efbb5a754a4a6e8935c
I20260808 05:03:33.182677 19665 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:33.186728 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.175269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39128 (local address 127.11.70.254:42545)
0808 05:03:33.175475 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.175486 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.175523 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:03:33.176232 (+ 709us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.176241 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.176303 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.176453 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.177038 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.178764 (+ 1726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.179952 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.180629 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.180728 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.183477 (+ 2749us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:33.183481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:33.183481 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:33.183500 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:33.185050 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.185447 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.185449 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.185450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.185540 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.185765 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.185765 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.185766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.185989 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:33.186162 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:33.186229 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 05:03:33.186372 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":98,"threads_started":1}
I20260808 05:03:33.192337 19665 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:33.193022 19665 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:33.200775 19665 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 45724d964f8644d7a53fe544cbf950e4: Generated new TSK 0
I20260808 05:03:33.200938 19665 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:33.231467 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42545
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:45651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:33.333643 19685 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:33.333887 19685 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:33.333912 19685 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:33.335136 19685 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:33.335180 19685 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:33.335206 19685 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:33.336687 19685 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19685
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:33.336928 19685 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:33.337148 19685 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:33.342970 19692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:33.342993 19693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:33.343011 19696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:33.343251 19685 server_base.cc:1034] running on GCE node
I20260808 05:03:33.343510 19685 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:33.343751 19685 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:33.344913 19685 hybrid_clock.cc:648] HybridClock initialized: now 1786165413344896 us; error 33 us; skew 500 ppm
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.347496 19685 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:33.347868 19685 webserver.cc:460] Webserver started at http://127.11.70.193:38107/ using document root <none> and password file <none>
I20260808 05:03:33.348047 19685 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:33.348088 19685 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:33.348183 19685 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:33.349188 19685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "f055462e5d824e90a1ea8a573797783c"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "bb8202f3e425dff699b05ec743a727f0"
server_key_iv: "dd536d892fde48d43f4f563de86f9d5a"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.349493 19685 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "f055462e5d824e90a1ea8a573797783c"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "bb8202f3e425dff699b05ec743a727f0"
server_key_iv: "dd536d892fde48d43f4f563de86f9d5a"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.350772 19685 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:33.351476 19703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.351655 19685 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:33.351763 19685 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "f055462e5d824e90a1ea8a573797783c"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "bb8202f3e425dff699b05ec743a727f0"
server_key_iv: "dd536d892fde48d43f4f563de86f9d5a"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.351835 19685 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:33.359192 19685 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:33.361543 19685 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:33.361702 19685 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:33.361922 19685 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:33.362221 19685 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:33.362274 19685 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.362314 19685 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:33.362341 19685 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.368656 19685 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:40239
I20260808 05:03:33.368733 19889 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:40239 every 8 connection(s)
I20260808 05:03:33.369091 19685 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:33.377400 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 19685
I20260808 05:03:33.377492 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:33.377736 11547 external_mini_cluster.cc:1428] Setting key 91a828d9ce0ff5dcb39a74ed698d0dda
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:33.382575 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.369828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:46101 (local address 127.11.70.254:42545)
0808 05:03:33.369876 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.369879 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.370078 (+ 199us) server_negotiation.cc:407] Connection header received
0808 05:03:33.371006 (+ 928us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.371007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.371017 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.371070 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.371609 (+ 539us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.372098 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.373017 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.373208 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.373258 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.379406 (+ 6148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:33.379408 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:33.379408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:33.379417 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:33.381135 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.381535 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.381536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.381536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.381605 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.381828 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.381829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.381829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.381983 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:33.382057 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:33.382302 (+ 245us) server_negotiation.cc:299] Negotiation successful
0808 05:03:33.382399 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:03:33.382586 19894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.369798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:42545 (local address 127.11.70.193:46101)
0808 05:03:33.369962 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:33.369997 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:33.370914 (+ 917us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:33.371120 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:33.371123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:33.371362 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:33.371536 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:33.371540 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.372186 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.372187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:33.372942 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:33.372944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.373280 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.373281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:33.373377 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.377420 (+ 4043us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:33.377429 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:33.379217 (+ 1788us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:33.381231 (+ 2014us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:33.381238 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:33.381240 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:33.381455 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:33.381676 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:33.381677 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:33.381677 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:33.381775 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:33.382049 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:33.382054 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:33.382169 (+ 115us) client_negotiation.cc:769] Sending connection context
0808 05:03:33.382249 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:03:33.382366 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":100,"threads_started":1}
I20260808 05:03:33.383096 19890 heartbeater.cc:347] Connected to a master server at 127.11.70.254:42545
I20260808 05:03:33.383210 19890 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:33.383384 19890 heartbeater.cc:511] Master 127.11.70.254:42545 requested a full tablet report, sending...
I20260808 05:03:33.383885 19585 ts_manager.cc:194] Registered new tserver with Master: f055462e5d824e90a1ea8a573797783c (127.11.70.193:40239)
I20260808 05:03:33.384522 19585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:46101
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:33.404675 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42545
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:45651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:33.487581 19898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:33.487802 19898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:33.487826 19898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:33.488998 19898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:33.489046 19898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:33.489104 19898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:33.490674 19898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:33.490928 19898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:33.491164 19898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:33.496891 19903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:33.496999 19904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:33.496893 19906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:33.497135 19898 server_base.cc:1034] running on GCE node
I20260808 05:03:33.497354 19898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:33.497592 19898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:33.498728 19898 hybrid_clock.cc:648] HybridClock initialized: now 1786165413498708 us; error 37 us; skew 500 ppm
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.501322 19898 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:33.501850 19898 webserver.cc:460] Webserver started at http://127.11.70.194:45229/ using document root <none> and password file <none>
I20260808 05:03:33.502125 19898 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:33.502177 19898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:33.502367 19898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:33.503590 19898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "0874c07fc5e34e2b8030e7a307fd701e"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "d261b03208ee17876f0c9dbe6318ba25"
server_key_iv: "b8c92b90835dc5166c403864fa4dd7fc"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.503983 19898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "0874c07fc5e34e2b8030e7a307fd701e"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "d261b03208ee17876f0c9dbe6318ba25"
server_key_iv: "b8c92b90835dc5166c403864fa4dd7fc"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.505498 19898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:33.506229 19915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.506402 19898 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.506523 19898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "0874c07fc5e34e2b8030e7a307fd701e"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "d261b03208ee17876f0c9dbe6318ba25"
server_key_iv: "b8c92b90835dc5166c403864fa4dd7fc"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.506608 19898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:33.516232 19898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:33.517958 19898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:33.518113 19898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:33.518348 19898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:33.518697 19898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:33.518754 19898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.518800 19898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:33.518827 19898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.524714 19898 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:44941
I20260808 05:03:33.524814 20082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:44941 every 8 connection(s)
I20260808 05:03:33.525095 19898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:33.529563 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 19898
I20260808 05:03:33.529678 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:33.529889 11547 external_mini_cluster.cc:1428] Setting key f84b9a1822c43dad4526b7944932900f
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:33.535341 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.525821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:59605 (local address 127.11.70.254:42545)
0808 05:03:33.525906 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.525908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.526057 (+ 149us) server_negotiation.cc:407] Connection header received
0808 05:03:33.527037 (+ 980us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.527039 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.527052 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.527130 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.528089 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.528585 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.529546 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.529876 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.529956 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.532401 (+ 2445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:33.532403 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:33.532403 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:33.532410 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:33.533834 (+ 1424us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.534253 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.534254 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.534255 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.534321 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.534652 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.534653 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.534654 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.534773 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:33.534862 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:33.535166 (+ 304us) server_negotiation.cc:299] Negotiation successful
0808 05:03:33.535251 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:03:33.535522 20085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.525770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:42545 (local address 127.11.70.194:59605)
0808 05:03:33.525935 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:33.525969 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:33.526932 (+ 963us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:33.527200 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:33.527205 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:33.527638 (+ 433us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:33.527963 (+ 325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:33.527968 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.528668 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.528669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:33.529452 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:33.529454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.529980 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.529982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:33.530115 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.530747 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:33.530755 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:33.532302 (+ 1547us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:33.533941 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:33.533949 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:33.533951 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:33.534174 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:33.534397 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:33.534398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:33.534398 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:33.534582 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:33.534893 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:33.534900 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:33.535026 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 05:03:33.535126 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 05:03:33.535285 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260808 05:03:33.536293 20083 heartbeater.cc:347] Connected to a master server at 127.11.70.254:42545
I20260808 05:03:33.536399 20083 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:33.536573 20083 heartbeater.cc:511] Master 127.11.70.254:42545 requested a full tablet report, sending...
I20260808 05:03:33.536980 19585 ts_manager.cc:194] Registered new tserver with Master: 0874c07fc5e34e2b8030e7a307fd701e (127.11.70.194:44941)
I20260808 05:03:33.537482 19585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:59605
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:33.555503 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42545
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:45651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:33.638792 20091 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:33.639043 20091 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:33.639081 20091 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:33.640245 20091 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:33.640319 20091 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:33.640363 20091 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:33.641887 20091 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:42545
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20091
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:33.642150 20091 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:33.642402 20091 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:33.647996 20108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:33.648010 20102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:33.648066 20104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:33.648337 20091 server_base.cc:1034] running on GCE node
I20260808 05:03:33.648684 20091 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:33.648937 20091 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:33.650104 20091 hybrid_clock.cc:648] HybridClock initialized: now 1786165413650096 us; error 37 us; skew 500 ppm
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.652798 20091 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:33.653334 20091 webserver.cc:460] Webserver started at http://127.11.70.195:42245/ using document root <none> and password file <none>
I20260808 05:03:33.653522 20091 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:33.653561 20091 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:33.653712 20091 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:33.654852 20091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "5cc90e8f2fe7445a8d3876d2154da35c"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "a92a868b26513eff95994da50065aacd"
server_key_iv: "043ea1127df385130e29ab54b35ae133"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.655164 20091 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "5cc90e8f2fe7445a8d3876d2154da35c"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "a92a868b26513eff95994da50065aacd"
server_key_iv: "043ea1127df385130e29ab54b35ae133"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.656657 20091 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:33.657384 20118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.657583 20091 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:33.657678 20091 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "5cc90e8f2fe7445a8d3876d2154da35c"
format_stamp: "Formatted at 2026-08-08 05:03:33 on dist-test-slave-7kzw"
server_key: "a92a868b26513eff95994da50065aacd"
server_key_iv: "043ea1127df385130e29ab54b35ae133"
server_key_version: "encryptionkey@0"
I20260808 05:03:33.657755 20091 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:33.672122 20091 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:33.674072 20091 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:33.674247 20091 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:33.674551 20091 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:33.674921 20091 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:33.674957 20091 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.675014 20091 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:33.675042 20091 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:33.681624 20091 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:44689
I20260808 05:03:33.681671 20296 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:44689 every 8 connection(s)
I20260808 05:03:33.682014 20091 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:33.690583 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 20091
I20260808 05:03:33.690701 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:33.690914 11547 external_mini_cluster.cc:1428] Setting key 8300aca10c7b14d5bfb3678f2a4f80e7
I20260808 05:03:33.691653 19652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.682788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:56785 (local address 127.11.70.254:42545)
0808 05:03:33.682857 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.682860 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.683106 (+ 246us) server_negotiation.cc:407] Connection header received
0808 05:03:33.684040 (+ 934us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.684042 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.684053 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.684107 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.684698 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.685202 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.686160 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.686366 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.686438 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.688651 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:33.688653 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:33.688653 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:33.688661 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:33.690175 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.690568 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.690569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.690570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.690634 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.690915 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.690916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.690917 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.691055 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:33.691121 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:33.691479 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 05:03:33.691576 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:03:33.691845 20299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.682778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:42545 (local address 127.11.70.195:56785)
0808 05:03:33.682983 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:33.683021 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:33.683942 (+ 921us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:33.684163 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:33.684166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:33.684431 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:33.684621 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:33.684625 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.685286 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.685286 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:33.686061 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:33.686063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.686517 (+ 454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.686518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:33.686632 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.687187 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:33.687196 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:33.688568 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:33.690248 (+ 1680us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:33.690253 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:33.690255 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:33.690458 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:33.690713 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:33.690713 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:33.690714 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:33.690846 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:33.691134 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:33.691142 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:33.691311 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 05:03:33.691423 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 05:03:33.691619 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":104,"threads_started":1}
I20260808 05:03:33.692263 20297 heartbeater.cc:347] Connected to a master server at 127.11.70.254:42545
I20260808 05:03:33.692381 20297 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:33.692585 20297 heartbeater.cc:511] Master 127.11.70.254:42545 requested a full tablet report, sending...
I20260808 05:03:33.692970 19585 ts_manager.cc:194] Registered new tserver with Master: 5cc90e8f2fe7445a8d3876d2154da35c (127.11.70.195:44689)
I20260808 05:03:33.693339 19585 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:56785
I20260808 05:03:33.702731 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/test-admin.keytab.
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.719277 11547 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 05:03:33.720914 20305 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:33.720194 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34414 (local address 127.11.70.193:40239)
0808 05:03:33.720368 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.720373 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.720382 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:33.720409 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.720410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.720424 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.720489 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.720825 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34414: BlockingRecv error: recv got EOF from 127.0.0.1:34414 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
W20260808 05:03:33.720999 11547 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5cc' of type FILE
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.721962 11547 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.722934 11547 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:33.730592 20305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.723430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34424 (local address 127.11.70.193:40239)
0808 05:03:33.723509 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.723511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.723555 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:03:33.723598 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.723599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.723609 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.723657 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.724030 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.724744 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.725413 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.725714 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.725770 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.727922 (+ 2152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:33.727929 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:33.727930 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:33.727936 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:33.729331 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.729652 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.729654 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.729655 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.729709 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.729950 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.729951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.729951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.730083 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:33.730181 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:33.730349 (+ 168us) server_negotiation.cc:299] Negotiation successful
0808 05:03:33.730412 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 05:03:33.732439 20305 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:33.731967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34426 (local address 127.11.70.193:40239)
0808 05:03:33.732005 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.732007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.732073 (+ 66us) server_negotiation.cc:407] Connection header received
0808 05:03:33.732120 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.732121 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.732129 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.732176 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.732387 (+ 211us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34426: BlockingRecv error: recv got EOF from 127.0.0.1:34426 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 05:03:33.732666 11547 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5cc)
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.733577 11547 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.734441 11547 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:33.742116 20305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.735026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34428 (local address 127.11.70.193:40239)
0808 05:03:33.735081 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.735083 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.735112 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:03:33.735173 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.735174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.735184 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.735262 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.735604 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.736463 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.737139 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.737490 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.737574 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.739828 (+ 2254us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:33.739830 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:33.739831 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:33.739839 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:33.741006 (+ 1167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.741367 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.741368 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.741368 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.741432 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.741630 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.741631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.741631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.741736 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:33.741831 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:33.741943 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 05:03:33.742023 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 05:03:33.743515 20305 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:33.743038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34432 (local address 127.11.70.193:40239)
0808 05:03:33.743074 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.743076 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.743110 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:03:33.743188 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.743189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.743196 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.743244 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.743470 (+ 226us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34432: BlockingRecv error: recv got EOF from 127.0.0.1:34432 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 05:03:33.743634 11547 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165386228479-11547-0/krb5kdc/krb5cc)
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.744547 11547 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:33.745348 11547 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[19520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:03:33.751808 20305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:33.745800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34434 (local address 127.11.70.193:40239)
0808 05:03:33.745848 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:33.745850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:33.745858 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:33.745917 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:33.745918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:33.745925 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:33.745964 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:33.746302 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.746799 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.747431 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:33.747599 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:33.747645 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:33.749533 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:33.749534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:33.749535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:33.749541 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:33.750917 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.751199 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.751200 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.751200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.751249 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:33.751398 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:33.751398 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:33.751398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:33.751469 (+ 71us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:33.751543 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:33.751618 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 05:03:33.751672 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:03:33.752339 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 19685
I20260808 05:03:33.767519 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 19898
I20260808 05:03:33.777376 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 20091
I20260808 05:03:33.794160 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 19540
2026-08-08T05:03:33Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2100 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[20324](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[20324](info): set up 2 sockets
Aug 08 05:03:33 dist-test-slave-7kzw krb5kdc[20324](info): commencing operation
krb5kdc: starting...
W20260808 05:03:35.103796 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260808 05:03:35.276203 11547 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.172s user 0.001s sys 0.002s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260808 05:03:35.397949 11547 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.122s user 0.001s sys 0.001s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260808 05:03:35.535154 11547 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.137s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/test-user.keytab.
W20260808 05:03:35.923640 11547 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.388s user 0.000s sys 0.002s
Aug 08 05:03:35 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:35Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.254.keytab.
Entry for principal oryx/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.254.keytab.
I20260808 05:03:35.973063 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:39095
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.254.keytab
--principal=oryx/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:39095
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:36.059197 20343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:36.059401 20343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:36.059423 20343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:36.060510 20343 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:36.060550 20343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:36.060564 20343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:36.060585 20343 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:36.060597 20343 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:36.062009 20343 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:39095
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.254.keytab
--principal=oryx/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:39095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:36.062204 20343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:36.062377 20343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:36.067271 20348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.067409 20351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.067313 20349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:36.067515 20343 server_base.cc:1034] running on GCE node
I20260808 05:03:36.067798 20343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:36.068104 20343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:36.069303 20343 hybrid_clock.cc:648] HybridClock initialized: now 1786165416069285 us; error 53 us; skew 500 ppm
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:36.071998 20343 init.cc:377] Logged in from keytab as oryx/127.11.70.254@KRBTEST.COM (short username oryx)
I20260808 05:03:36.072471 20343 webserver.cc:460] Webserver started at http://127.11.70.254:36571/ using document root <none> and password file <none>
I20260808 05:03:36.072701 20343 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:36.072778 20343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:36.072932 20343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:36.074015 20343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "6ebdad661391434fa59236ad37e2fb05"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "c2826174e4190b5a34920453bd80050b"
server_key_iv: "5991e8b52ad4b65f15a092729c01f45a"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.074386 20343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "6ebdad661391434fa59236ad37e2fb05"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "c2826174e4190b5a34920453bd80050b"
server_key_iv: "5991e8b52ad4b65f15a092729c01f45a"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.075764 20343 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:36.076498 20365 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.076700 20343 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.076810 20343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "6ebdad661391434fa59236ad37e2fb05"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "c2826174e4190b5a34920453bd80050b"
server_key_iv: "5991e8b52ad4b65f15a092729c01f45a"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.076895 20343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:36.089885 20343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:36.092259 20343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:36.092422 20343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:36.096913 20343 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:39095
I20260808 05:03:36.096952 20438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:39095 every 8 connection(s)
I20260808 05:03:36.097302 20343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:36.098042 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 20343
I20260808 05:03:36.098176 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:36.098361 11547 external_mini_cluster.cc:1428] Setting key e8a84b5ece3321701eb82e7997aa2f21
I20260808 05:03:36.098376 20439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:36.101827 20439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: Bootstrap starting.
I20260808 05:03:36.102583 20439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:36.102897 20439 log.cc:824] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:36.103590 20439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: No bootstrap required, opened a new log
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:36.105742 20439 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } }
I20260808 05:03:36.105973 20439 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:36.106058 20439 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ebdad661391434fa59236ad37e2fb05, State: Initialized, Role: FOLLOWER
I20260808 05:03:36.106200 20439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } }
I20260808 05:03:36.106310 20439 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:36.106376 20439 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:36.106482 20439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:36.107225 20439 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } }
I20260808 05:03:36.107370 20439 leader_election.cc:302] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ebdad661391434fa59236ad37e2fb05; no voters:
I20260808 05:03:36.107561 20439 leader_election.cc:288] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:36.107844 20439 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:36.107921 20445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:36.108249 20445 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 1 LEADER]: Becoming Leader. State: Replica: 6ebdad661391434fa59236ad37e2fb05, State: Running, Role: LEADER
I20260808 05:03:36.108345 20445 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } }
I20260808 05:03:36.108774 20445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ebdad661391434fa59236ad37e2fb05. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } }
I20260808 05:03:36.108780 20446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } }
I20260808 05:03:36.108938 20445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:36.108946 20446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
W20260808 05:03:36.110180 20463 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:03:36.110239 20463 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:03:36.110273 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.098920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50442 (local address 127.11.70.254:39095)
0808 05:03:36.099101 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.099110 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.099143 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:03:36.099581 (+ 438us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.099587 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.099632 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.099739 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.100551 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.101427 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.102512 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.102991 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.103128 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.106302 (+ 3174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.106305 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.106306 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.106318 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.108437 (+ 2119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.108897 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.108900 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.108901 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.109005 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.109219 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.109220 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.109220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.109577 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.109750 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.109989 (+ 239us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.110094 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":97,"threads_started":1}
I20260808 05:03:36.110319 20466 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:36.110625 20466 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:36.112121 20466 catalog_manager.cc:1347] Generated new cluster ID: 6fd2726a373d45cf8be486c4da27b8d2
I20260808 05:03:36.112185 20466 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:36.130542 20466 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:36.131086 20466 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:36.134524 20466 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: Generated new TSK 0
I20260808 05:03:36.134716 20466 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab.
Entry for principal oryx/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab.
I20260808 05:03:36.167421 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39095
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab
--principal=oryx/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:36.272341 20472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:36.272538 20472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:36.272562 20472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:36.273691 20472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:36.273736 20472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:36.273761 20472 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:36.275209 20472 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab
--principal=oryx/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:36.275399 20472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:36.275585 20472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:36.280567 20479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.280781 20484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:36.280681 20472 server_base.cc:1034] running on GCE node
W20260808 05:03:36.280556 20480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:36.281033 20472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:36.281318 20472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:36.282506 20472 hybrid_clock.cc:648] HybridClock initialized: now 1786165416282455 us; error 29 us; skew 500 ppm
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:36.285023 20472 init.cc:377] Logged in from keytab as oryx/127.11.70.193@KRBTEST.COM (short username oryx)
I20260808 05:03:36.285403 20472 webserver.cc:460] Webserver started at http://127.11.70.193:35657/ using document root <none> and password file <none>
I20260808 05:03:36.285576 20472 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:36.285615 20472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:36.285702 20472 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:36.286731 20472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "c208a29c7a214f9abe84ae90c0a836bf"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "5fe288a2ecaf33738f21f5fc0e08eeba"
server_key_iv: "ab9db1d0aacf5270d360c48d4c5d5f32"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.287041 20472 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "c208a29c7a214f9abe84ae90c0a836bf"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "5fe288a2ecaf33738f21f5fc0e08eeba"
server_key_iv: "ab9db1d0aacf5270d360c48d4c5d5f32"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.288321 20472 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:36.289037 20492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.289220 20472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:36.289330 20472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "c208a29c7a214f9abe84ae90c0a836bf"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "5fe288a2ecaf33738f21f5fc0e08eeba"
server_key_iv: "ab9db1d0aacf5270d360c48d4c5d5f32"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.289404 20472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:36.303347 20472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:36.305111 20472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:36.305271 20472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:36.305492 20472 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:36.305799 20472 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:36.305855 20472 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.305894 20472 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:36.305924 20472 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.312510 20472 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:34215
I20260808 05:03:36.312558 20654 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:34215 every 8 connection(s)
I20260808 05:03:36.312865 20472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:36.313616 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 20472
I20260808 05:03:36.313741 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:36.313959 11547 external_mini_cluster.cc:1428] Setting key 75c8a288c6851959a50bdfd62422c490
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:36.323571 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.313532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:37845 (local address 127.11.70.254:39095)
0808 05:03:36.314161 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.314163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.314174 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:36.314500 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.314502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.314513 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.314580 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.315565 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.316333 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.317892 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.318123 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.318205 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.320421 (+ 2216us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.320423 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.320423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.320431 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.322105 (+ 1674us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.322557 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.322558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.322559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.322629 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.322890 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.322891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.322892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.323044 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.323119 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.323367 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.323456 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":603}
I20260808 05:03:36.323588 20659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.313520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.193:37845)
0808 05:03:36.313682 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:36.313752 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:36.314372 (+ 620us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:36.314645 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:36.314650 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:36.315268 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:36.315454 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.315459 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.316430 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.316431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.317749 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.317753 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.318213 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.318214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.318357 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.318927 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:36.318935 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:36.320326 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:36.322202 (+ 1876us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.322209 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.322211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.322428 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.322701 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.322701 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.322702 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.322822 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.323113 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:36.323118 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:36.323231 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 05:03:36.323312 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 05:03:36.323429 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":96,"threads_started":1}
I20260808 05:03:36.324276 20655 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39095
I20260808 05:03:36.324386 20655 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:36.324579 20655 heartbeater.cc:511] Master 127.11.70.254:39095 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.11.70.194@KRBTEST.COM; defaulting to no policy
I20260808 05:03:36.325219 20389 ts_manager.cc:194] Registered new tserver with Master: c208a29c7a214f9abe84ae90c0a836bf (127.11.70.193:34215)
I20260808 05:03:36.325853 20389 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:37845
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab.
Entry for principal oryx/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab.
I20260808 05:03:36.343012 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39095
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab
--principal=oryx/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:36.425591 20663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:36.425799 20663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:36.425823 20663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:36.426901 20663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:36.426935 20663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:36.426960 20663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:36.428349 20663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab
--principal=oryx/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:36.428543 20663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:36.428718 20663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:36.433614 20674 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.433589 20677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.433748 20669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:36.433961 20663 server_base.cc:1034] running on GCE node
I20260808 05:03:36.434217 20663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:36.434455 20663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:36.435658 20663 hybrid_clock.cc:648] HybridClock initialized: now 1786165416435637 us; error 39 us; skew 500 ppm
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:36.438184 20663 init.cc:377] Logged in from keytab as oryx/127.11.70.194@KRBTEST.COM (short username oryx)
I20260808 05:03:36.438632 20663 webserver.cc:460] Webserver started at http://127.11.70.194:33853/ using document root <none> and password file <none>
I20260808 05:03:36.438835 20663 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:36.438876 20663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:36.438963 20663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:36.439927 20663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "110aa8a723ee413abbe59cb435f2ac6c"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "dd4b51500e17e526a73cacc7fee17b2e"
server_key_iv: "06431a6b6c80d075554768bc339cb355"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.440227 20663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "110aa8a723ee413abbe59cb435f2ac6c"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "dd4b51500e17e526a73cacc7fee17b2e"
server_key_iv: "06431a6b6c80d075554768bc339cb355"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.441463 20663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:36.442152 20691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.442333 20663 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.442436 20663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "110aa8a723ee413abbe59cb435f2ac6c"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "dd4b51500e17e526a73cacc7fee17b2e"
server_key_iv: "06431a6b6c80d075554768bc339cb355"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.442554 20663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:36.455888 20663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:36.457854 20663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:36.458017 20663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:36.458243 20663 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:36.458667 20663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:36.458734 20663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.458773 20663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:36.458801 20663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.464679 20663 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:37021
I20260808 05:03:36.464756 20864 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:37021 every 8 connection(s)
I20260808 05:03:36.465085 20663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:36.467876 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 20663
I20260808 05:03:36.467986 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:36.468187 11547 external_mini_cluster.cc:1428] Setting key f7617b7a243dcf0c8d1686edd4cb5104
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:36.475317 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.465822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:39925 (local address 127.11.70.254:39095)
0808 05:03:36.465907 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.465910 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.466073 (+ 163us) server_negotiation.cc:407] Connection header received
0808 05:03:36.466604 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.466605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.466615 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.466669 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.467569 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.468375 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.469536 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.469853 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.469928 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.472325 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.472327 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.472327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.472335 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.473840 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.474248 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.474249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.474250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.474314 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.474642 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.474643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.474644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.474765 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.474845 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.475123 (+ 278us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.475223 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:03:36.475494 20868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.465784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.194:39925)
0808 05:03:36.465954 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:36.465989 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:36.466456 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:36.466722 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:36.466726 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:36.467306 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:36.467491 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.467495 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.468467 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.468469 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.469442 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.469445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.469940 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.469941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.470045 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.470574 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:36.470582 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:36.472225 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:36.473931 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.473939 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.473941 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.474168 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.474388 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.474389 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.474389 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.474572 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.474836 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:36.474844 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:36.474986 (+ 142us) client_negotiation.cc:769] Sending connection context
0808 05:03:36.475088 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 05:03:36.475252 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":107,"threads_started":1}
I20260808 05:03:36.475997 20865 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39095
I20260808 05:03:36.476094 20865 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:36.476298 20865 heartbeater.cc:511] Master 127.11.70.254:39095 requested a full tablet report, sending...
I20260808 05:03:36.476701 20389 ts_manager.cc:194] Registered new tserver with Master: 110aa8a723ee413abbe59cb435f2ac6c (127.11.70.194:37021)
I20260808 05:03:36.477231 20389 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:39925
WARNING: no policy specified for oryx/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab.
Entry for principal oryx/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab.
I20260808 05:03:36.495025 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39095
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab
--principal=oryx/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:36.577886 20873 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:36.578085 20873 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:36.578109 20873 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:36.579257 20873 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:36.579300 20873 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:36.579326 20873 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:36.580838 20873 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab
--principal=oryx/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39095
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20873
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:36.581081 20873 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:36.581312 20873 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:36.586401 20880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.586412 20886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.586429 20879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:36.586647 20873 server_base.cc:1034] running on GCE node
I20260808 05:03:36.586850 20873 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:36.587119 20873 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:36.588286 20873 hybrid_clock.cc:648] HybridClock initialized: now 1786165416588275 us; error 27 us; skew 500 ppm
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:36.590869 20873 init.cc:377] Logged in from keytab as oryx/127.11.70.195@KRBTEST.COM (short username oryx)
I20260808 05:03:36.591356 20873 webserver.cc:460] Webserver started at http://127.11.70.195:44045/ using document root <none> and password file <none>
I20260808 05:03:36.591596 20873 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:36.591666 20873 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:36.591812 20873 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:36.592941 20873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "eb940d57f34b4f92b9a47ba469e6fcb4"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "378cfe2b5f8b9922352fd7a5682eaa08"
server_key_iv: "1901337666c7fca8e4b519e7427939d2"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.593359 20873 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "eb940d57f34b4f92b9a47ba469e6fcb4"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "378cfe2b5f8b9922352fd7a5682eaa08"
server_key_iv: "1901337666c7fca8e4b519e7427939d2"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.594785 20873 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:36.595546 20894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.595744 20873 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:36.595850 20873 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "eb940d57f34b4f92b9a47ba469e6fcb4"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "378cfe2b5f8b9922352fd7a5682eaa08"
server_key_iv: "1901337666c7fca8e4b519e7427939d2"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.595934 20873 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:36.611955 20873 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:36.614238 20873 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:36.614404 20873 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:36.614732 20873 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:36.615046 20873 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:36.615087 20873 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.615108 20873 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:36.615157 20873 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.621238 20873 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:39115
I20260808 05:03:36.621299 21052 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:39115 every 8 connection(s)
I20260808 05:03:36.621598 20873 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:36.630602 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.622446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:36989 (local address 127.11.70.254:39095)
0808 05:03:36.622533 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.622536 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.622727 (+ 191us) server_negotiation.cc:407] Connection header received
0808 05:03:36.623194 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.623195 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.623205 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.623260 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.624135 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.624621 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.625568 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.625766 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.625816 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.627888 (+ 2072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.627890 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.627890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.627897 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.629329 (+ 1432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.629686 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.629686 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.629687 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.629739 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.629947 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.629948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.629948 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.630048 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.630097 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.630387 (+ 290us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.630454 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260808 05:03:36.630765 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 20873
I20260808 05:03:36.630803 21058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.622412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.195:36989)
0808 05:03:36.622592 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:36.622634 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:36.623109 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:36.623309 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:36.623313 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:36.623873 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:36.624059 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.624063 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.624710 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.624711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.625492 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.625494 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.625849 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.625850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.625947 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.626364 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:36.626373 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:36.627801 (+ 1428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:36.629399 (+ 1598us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.629404 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.629405 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.629607 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.629797 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.629797 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.629797 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.629893 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.630111 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:36.630118 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:36.630268 (+ 150us) client_negotiation.cc:769] Sending connection context
0808 05:03:36.630354 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 05:03:36.630523 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":109,"threads_started":1}
I20260808 05:03:36.630883 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:36.631079 11547 external_mini_cluster.cc:1428] Setting key 1da6d40175a1b3081f05fd8f42048022
I20260808 05:03:36.631280 21055 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39095
I20260808 05:03:36.631388 21055 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:36.631580 21055 heartbeater.cc:511] Master 127.11.70.254:39095 requested a full tablet report, sending...
I20260808 05:03:36.632004 20389 ts_manager.cc:194] Registered new tserver with Master: eb940d57f34b4f92b9a47ba469e6fcb4 (127.11.70.195:39115)
I20260808 05:03:36.632352 20389 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:36989
I20260808 05:03:36.642882 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.70.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.253.keytab.
Entry for principal oryx/127.11.70.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.253.keytab.
I20260808 05:03:36.669055 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.253:40563
--webserver_interface=127.11.70.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.253.keytab
--principal=oryx/127.11.70.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:39095,127.11.70.253:40563
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:36.751951 21061 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:36.752153 21061 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:36.752174 21061 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:36.753316 21061 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:36.753373 21061 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:36.753430 21061 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:36.753454 21061 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:36.753481 21061 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:36.754957 21061 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:39095,127.11.70.253:40563
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.253.keytab
--principal=oryx/127.11.70.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.253:40563
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.70.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21061
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
W20260808 05:03:36.755091 21061 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.11.70.254:39095,127.11.70.253:40563'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 05:03:36.755254 21061 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:36.755501 21061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:36.760381 21073 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.760401 21069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.760438 21070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:36.760540 21061 server_base.cc:1034] running on GCE node
I20260808 05:03:36.760792 21061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:36.761034 21061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:36.762176 21061 hybrid_clock.cc:648] HybridClock initialized: now 1786165416762147 us; error 43 us; skew 500 ppm
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:36.764747 21061 init.cc:377] Logged in from keytab as oryx/127.11.70.253@KRBTEST.COM (short username oryx)
I20260808 05:03:36.765172 21061 webserver.cc:460] Webserver started at http://127.11.70.253:43355/ using document root <none> and password file <none>
I20260808 05:03:36.765415 21061 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:36.765486 21061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:36.765643 21061 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:36.766750 21061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data/instance:
uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "10c4fe0785328444352e3dfd46f17fe2"
server_key_iv: "b85fb27314af374ad2ca3f7b9ddd92a6"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.767117 21061 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal/instance:
uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "10c4fe0785328444352e3dfd46f17fe2"
server_key_iv: "b85fb27314af374ad2ca3f7b9ddd92a6"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.768510 21061 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:36.769274 21080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.769446 21061 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:36.769551 21061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal
uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "10c4fe0785328444352e3dfd46f17fe2"
server_key_iv: "b85fb27314af374ad2ca3f7b9ddd92a6"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.769634 21061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:36.788877 21061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:36.791006 21061 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:36.791172 21061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:36.795420 21061 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.253:40563
I20260808 05:03:36.795460 21155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.253:40563 every 8 connection(s)
I20260808 05:03:36.795848 21061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
I20260808 05:03:36.796870 21158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:36.798416 21158 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.253@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:36.804252 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 21061
I20260808 05:03:36.807914 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.799298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50454 (local address 127.11.70.254:39095)
0808 05:03:36.799380 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.799383 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.799566 (+ 183us) server_negotiation.cc:407] Connection header received
0808 05:03:36.800121 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.800122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.800134 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.800194 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.800814 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.801311 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.802239 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.802430 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.802578 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.804851 (+ 2273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.804854 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.804854 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.804863 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.806349 (+ 1486us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.806804 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.806806 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.806806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.806870 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.807131 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.807132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.807132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.807306 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.807391 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.807688 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.807816 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 05:03:36.808056 21161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.799251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50454)
0808 05:03:36.799445 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:36.799482 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:36.799991 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:36.800283 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:36.800286 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:36.800540 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:36.800731 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.800735 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.801392 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.801393 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.802154 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.802156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.802599 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.802600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.802699 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.803195 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:36.803203 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:36.804747 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:36.806456 (+ 1709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.806484 (+ 28us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.806486 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.806721 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.806945 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.806946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.806947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.807063 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.807381 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:36.807388 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:36.807536 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 05:03:36.807652 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 05:03:36.807816 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":103,"threads_started":1}
I20260808 05:03:36.808737 21158 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.70.253@KRBTEST.COM
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.253@KRBTEST.COM for oryx/127.11.70.253@KRBTEST.COM
I20260808 05:03:36.813750 21165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.804946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43306 (local address 127.11.70.253:40563)
0808 05:03:36.805147 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.805153 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.805179 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:03:36.805226 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.805229 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.805243 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.805337 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.805922 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.806640 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.807393 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.807695 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.807850 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.810603 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.810610 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.810610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.810616 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.812289 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.812701 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.812704 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.812705 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.812773 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.812994 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.812995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.812996 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.813218 (+ 222us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.813365 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.813502 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.813588 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":85,"threads_started":1}
I20260808 05:03:36.816103 21161 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.809002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.0.0.1:43322)
0808 05:03:36.809050 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:36.809061 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:36.809122 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:36.809362 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:36.809363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:36.809473 (+ 110us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:36.809516 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.809518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.810176 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.810177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.810871 (+ 694us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.810874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.811216 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.811217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.811299 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.811794 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:36.811798 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:36.813095 (+ 1297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:36.815334 (+ 2239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.815335 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.815335 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.815495 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.815656 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.815656 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.815657 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.815708 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.815888 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:36.815889 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:36.815921 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 05:03:36.815971 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:03:36.816042 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:03:36.816213 21169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.809058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43322 (local address 127.11.70.253:40563)
0808 05:03:36.809229 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.809232 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.809240 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:36.809263 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.809264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.809275 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.809352 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.809592 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.810097 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.810946 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.811142 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.811218 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.813179 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.813180 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.813180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.813185 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.815264 (+ 2079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.815558 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.815558 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.815559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.815603 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.815761 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.815761 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.815761 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.815839 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.815881 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.815985 (+ 104us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.816084 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":43,"server-negotiator.queue_time_us":148,"thread_start_us":114,"threads_started":1}
I20260808 05:03:36.817425 21158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: Bootstrap starting.
I20260808 05:03:36.818069 21158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:36.818362 21158 log.cc:824] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:36.819198 21158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: No bootstrap required, opened a new log
I20260808 05:03:36.820568 21158 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } }
I20260808 05:03:36.820689 21158 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:36.820747 21158 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfdcc0ad4ed9486da87c2cd6bb0de50f, State: Initialized, Role: FOLLOWER
I20260808 05:03:36.820873 21158 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } }
I20260808 05:03:36.821125 21171 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } } }
I20260808 05:03:36.821187 21158 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:36.821249 21171 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:03:36.822928 21184 catalog_manager.cc:1558] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:03:36.822997 21184 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:03:36.824810 21061 master_runner.cc:428] Detected that this master dfdcc0ad4ed9486da87c2cd6bb0de50f is joining an existing cluster
I20260808 05:03:36.824873 21061 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.70.253:40563
I20260808 05:03:36.833192 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.826121 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50456 (local address 127.11.70.254:39095)
0808 05:03:36.826204 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.826206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.826212 (+ 6us) server_negotiation.cc:407] Connection header received
0808 05:03:36.826233 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.826234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.826251 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.826317 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.826745 (+ 428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.827240 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.827973 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.828180 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.828258 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.829293 (+ 1035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.829295 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.829295 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.829303 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.830973 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.832292 (+ 1319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.832293 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.832294 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.832355 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.832582 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.832583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.832584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.832725 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.832801 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.833002 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.833087 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260808 05:03:36.833194 21192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.825892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.0.0.1:43332)
0808 05:03:36.826114 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:36.826125 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:36.826186 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:36.826350 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:36.826350 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:36.826599 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:36.826667 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.826669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.827575 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.827575 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.828429 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.828432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.828934 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.828935 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.828990 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.829575 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:36.829581 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:36.829976 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:36.831824 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.831824 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.831825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.832112 (+ 287us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.832381 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.832382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.832382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.832454 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.832786 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:36.832787 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:36.832826 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 05:03:36.832924 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 05:03:36.833032 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":205,"thread_start_us":106,"threads_started":1}
I20260808 05:03:36.833472 21169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.826070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43332 (local address 127.11.70.253:40563)
0808 05:03:36.826160 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.826162 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.826174 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:03:36.826260 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.826261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.826270 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.826296 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.826756 (+ 460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.827484 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.828528 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.828827 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.828867 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.830069 (+ 1202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.830070 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.830070 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.830076 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.831734 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.832211 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.832213 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.832213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.832307 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.832527 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.832528 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.832528 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.832674 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.832775 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.832948 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.833105 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":87,"server-negotiator.queue_time_us":75}
I20260808 05:03:36.833763 21191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.825885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50456)
0808 05:03:36.826068 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:36.826079 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:36.826136 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:36.826322 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:36.826323 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:36.826586 (+ 263us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:36.826648 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.826650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.827334 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.827335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.827887 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.827889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.828259 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.828260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.828323 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.828785 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:36.828790 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:36.829190 (+ 400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:36.831829 (+ 2639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.831829 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.831830 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.832170 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.832409 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.832409 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.832410 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.832465 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.832826 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:36.832827 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:36.832876 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 05:03:36.833464 (+ 588us) client_negotiation.cc:240] Negotiation successful
0808 05:03:36.833656 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.254@KRBTEST.COM for oryx/127.11.70.253@KRBTEST.COM
I20260808 05:03:36.846858 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.836271 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.0.0.1:43340)
0808 05:03:36.839213 (+ 2942us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:36.839261 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:36.839338 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:36.839499 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:36.839505 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:36.839853 (+ 348us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:36.839914 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.839916 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.840502 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.840504 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.841431 (+ 927us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.841434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.841796 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.841797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.841882 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.842364 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:36.842370 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:36.843992 (+ 1622us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:36.845764 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.845770 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.845772 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.845976 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.846182 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.846183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.846183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.846246 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.846558 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:36.846565 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:36.846609 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 05:03:36.846677 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 05:03:36.846774 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2912,"thread_start_us":66,"threads_started":1}
I20260808 05:03:36.846895 21169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.836315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43340 (local address 127.11.70.253:40563)
0808 05:03:36.836348 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.836350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.839334 (+ 2984us) server_negotiation.cc:407] Connection header received
0808 05:03:36.839413 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.839414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.839423 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.839474 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.839996 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.840422 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.841519 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.841716 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.841773 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.844075 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.844076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.844077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.844084 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.845677 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.846048 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.846049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.846050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.846113 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.846309 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.846310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.846310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.846438 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.846540 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.846725 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.846805 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:03:36.847643 20389 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.70.253:40563: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f"
member_type: NON_VOTER
last_known_addr {
host: "127.11.70.253"
port: 40563
}
attrs {
promote: true
}
}
dest_uuid: "6ebdad661391434fa59236ad37e2fb05"
cas_config_opid_index: -1
I20260808 05:03:36.848040 20389 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } }
I20260808 05:03:36.848608 21196 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER dfdcc0ad4ed9486da87c2cd6bb0de50f (127.11.70.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } }
I20260808 05:03:36.848899 21118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:36.849673 21196 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.70.253:40563
I20260808 05:03:36.849754 21118 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Refusing update from remote peer 6ebdad661391434fa59236ad37e2fb05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 05:03:36.849756 21196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } }
I20260808 05:03:36.849812 21196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:36.850029 21061 master.cc:537] Master@127.11.70.253:40563 shutting down...
I20260808 05:03:36.850215 21195 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 05:03:36.851118 20367 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 05:03:36.851575 20367 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 -> Peer dfdcc0ad4ed9486da87c2cd6bb0de50f (127.11.70.253:40563): Couldn't send request to peer dfdcc0ad4ed9486da87c2cd6bb0de50f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 05:03:36.853052 21061 raft_consensus.cc:2229] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:36.853149 21061 raft_consensus.cc:2258] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:36.853199 21061 tablet_replica.cc:330] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: stopping tablet replica
I20260808 05:03:36.866087 21061 master.cc:552] Master@127.11.70.253:40563 shutdown complete.
I20260808 05:03:36.866135 21061 master_runner.cc:305] Clearing existing system tablet
I20260808 05:03:36.866287 21061 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:36.866343 21061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:36.867046 21061 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.867553 21201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.867678 21061 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:36.867744 21061 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.867767 21061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal
uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "10c4fe0785328444352e3dfd46f17fe2"
server_key_iv: "b85fb27314af374ad2ca3f7b9ddd92a6"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.868541 21061 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:36.869894 21061 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 05:03:36.869959 21061 log.cc:1196] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 05:03:36.870175 21061 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: Deleting consensus metadata
I20260808 05:03:36.870313 21061 master_runner.cc:315] Copying system tablet from 127.11.70.254:39095
I20260808 05:03:36.871032 21061 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: tablet copy: Beginning tablet copy session from remote peer at address 127.11.70.254:39095
I20260808 05:03:36.877703 21214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.871407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50470)
0808 05:03:36.871523 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:36.871535 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:36.871604 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:36.871748 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:36.871748 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:36.871931 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:36.871988 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.871990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.872999 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.872999 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.873594 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:36.873596 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.874071 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.874071 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:36.874120 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.874656 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:36.874660 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:36.874975 (+ 315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:36.876690 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.876691 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.876691 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.876873 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.877075 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:36.877076 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:36.877076 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:36.877152 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:36.877427 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:36.877428 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:36.877479 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 05:03:36.877550 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 05:03:36.877632 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":67,"threads_started":1}
I20260808 05:03:36.877907 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.871470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50470 (local address 127.11.70.254:39095)
0808 05:03:36.871521 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.871523 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.871587 (+ 64us) server_negotiation.cc:407] Connection header received
0808 05:03:36.871670 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.871671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.871681 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.871732 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.872107 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.872906 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.873679 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.873990 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.874066 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.875063 (+ 997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.875064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.875065 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.875073 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.876600 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.876943 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.876944 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.876945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.877008 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.877215 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.877216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.877216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.877353 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.877423 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.877598 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.877679 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:03:36.878216 20414 tablet_copy_service.cc:140] P 6ebdad661391434fa59236ad37e2fb05: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer dfdcc0ad4ed9486da87c2cd6bb0de50f ({username='oryx', principal='oryx/127.11.70.253@KRBTEST.COM'} at 127.0.0.1:50470)
I20260808 05:03:36.878358 20414 tablet_copy_service.cc:161] P 6ebdad661391434fa59236ad37e2fb05: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer dfdcc0ad4ed9486da87c2cd6bb0de50f at {username='oryx', principal='oryx/127.11.70.253@KRBTEST.COM'} at 127.0.0.1:50470: session id = dfdcc0ad4ed9486da87c2cd6bb0de50f-00000000000000000000000000000000
I20260808 05:03:36.879395 20414 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 05:03:36.880017 21061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 05:03:36.881248 21061 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: tablet copy: Starting download of 0 data blocks...
I20260808 05:03:36.881450 21061 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: tablet copy: Starting download of 1 WAL segments...
I20260808 05:03:36.882397 21061 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 05:03:36.883219 20414 tablet_copy_service.cc:342] P 6ebdad661391434fa59236ad37e2fb05: Request end of tablet copy session dfdcc0ad4ed9486da87c2cd6bb0de50f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.70.253@KRBTEST.COM'} at 127.0.0.1:50470
I20260808 05:03:36.883280 20414 tablet_copy_service.cc:433] P 6ebdad661391434fa59236ad37e2fb05: ending tablet copy session dfdcc0ad4ed9486da87c2cd6bb0de50f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer dfdcc0ad4ed9486da87c2cd6bb0de50f
I20260808 05:03:36.885963 21061 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:36.887240 21220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.887355 21215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:36.887485 21222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:36.890650 21061 server_base.cc:1034] running on GCE node
I20260808 05:03:36.890789 21061 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:36.890964 21061 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:36.892087 21061 hybrid_clock.cc:648] HybridClock initialized: now 1786165416892078 us; error 28 us; skew 500 ppm
Aug 08 05:03:36 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:36.893515 21061 init.cc:377] Logged in from keytab as oryx/127.11.70.253@KRBTEST.COM (short username oryx)
I20260808 05:03:36.893829 21061 webserver.cc:460] Webserver started at http://127.11.70.253:41531/ using document root <none> and password file <none>
I20260808 05:03:36.893937 21061 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:36.893963 21061 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:36.894666 21061 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:36.895213 21231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.895364 21061 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:36.895421 21061 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal
uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "10c4fe0785328444352e3dfd46f17fe2"
server_key_iv: "b85fb27314af374ad2ca3f7b9ddd92a6"
server_key_version: "encryptionkey@0"
I20260808 05:03:36.895469 21061 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:36.912086 21061 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:36.913776 21061 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:36.917424 21061 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.253:40563
I20260808 05:03:36.917443 21300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.253:40563 every 8 connection(s)
I20260808 05:03:36.917775 21061 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
I20260808 05:03:36.918838 21301 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:03:36.919428 21301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: Bootstrap starting.
I20260808 05:03:36.922729 21301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:03:36.922979 21301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: Bootstrap complete.
I20260808 05:03:36.923192 21301 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } }
I20260808 05:03:36.923285 21301 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: dfdcc0ad4ed9486da87c2cd6bb0de50f, State: Initialized, Role: LEARNER
I20260808 05:03:36.923326 21301 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } }
I20260808 05:03:36.923511 21301 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:36.923508 21304 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } }
I20260808 05:03:36.923632 21304 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: This master's current role is: LEARNER
I20260808 05:03:36.925108 21321 catalog_manager.cc:1259] Loaded cluster ID: 6fd2726a373d45cf8be486c4da27b8d2
I20260808 05:03:36.925156 21321 catalog_manager.cc:1552] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: loading cluster ID for follower catalog manager: success
I20260808 05:03:36.926147 21321 catalog_manager.cc:1574] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: acquiring CA information for follower catalog manager: success
I20260808 05:03:36.926425 21321 catalog_manager.cc:1602] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:03:36.972492 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:36.966013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43370 (local address 127.11.70.253:40563)
0808 05:03:36.966168 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:36.966170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:36.966177 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:36.966201 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:36.966201 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:36.966234 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:36.966314 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:36.966973 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.967635 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.968363 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:36.968583 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:36.968660 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:36.969989 (+ 1329us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:36.969991 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:36.969991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:36.969999 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:36.971332 (+ 1333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.971680 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.971681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.971682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.971744 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:36.971953 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:36.971954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:36.971954 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:36.972069 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:36.972178 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:36.972285 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 05:03:36.972371 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for oryx/127.11.70.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.252@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.252.keytab.
Entry for principal oryx/127.11.70.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.252.keytab.
I20260808 05:03:36.998849 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.252:39183
--webserver_interface=127.11.70.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.252.keytab
--principal=oryx/127.11.70.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:39095,127.11.70.253:40563,127.11.70.252:39183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:37.084641 21329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:37.084837 21329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:37.084860 21329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:37.085988 21329 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:37.086030 21329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:37.086045 21329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:37.086098 21329 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:37.086122 21329 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:37.087949 21329 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:39095,127.11.70.253:40563,127.11.70.252:39183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.252.keytab
--principal=oryx/127.11.70.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.252:39183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.70.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21329
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:37.088222 21329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:37.088485 21329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:37.093560 21337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:37.093572 21338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:37.093608 21340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:37.093971 21329 server_base.cc:1034] running on GCE node
I20260808 05:03:37.094249 21329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:37.094583 21329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:37.095758 21329 hybrid_clock.cc:648] HybridClock initialized: now 1786165417095744 us; error 26 us; skew 500 ppm
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:37.098428 21329 init.cc:377] Logged in from keytab as oryx/127.11.70.252@KRBTEST.COM (short username oryx)
I20260808 05:03:37.098897 21329 webserver.cc:460] Webserver started at http://127.11.70.252:36743/ using document root <none> and password file <none>
I20260808 05:03:37.099121 21329 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:37.099174 21329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:37.099326 21329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:37.100407 21329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data/instance:
uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2"
format_stamp: "Formatted at 2026-08-08 05:03:37 on dist-test-slave-7kzw"
server_key: "e55d5bfa667bed4d3fb7f3f16a85de15"
server_key_iv: "53930de149c659f8502bead002ab2369"
server_key_version: "encryptionkey@0"
I20260808 05:03:37.100767 21329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal/instance:
uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2"
format_stamp: "Formatted at 2026-08-08 05:03:37 on dist-test-slave-7kzw"
server_key: "e55d5bfa667bed4d3fb7f3f16a85de15"
server_key_iv: "53930de149c659f8502bead002ab2369"
server_key_version: "encryptionkey@0"
I20260808 05:03:37.102174 21329 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 05:03:37.102980 21347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.103184 21329 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:37.103279 21329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal
uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2"
format_stamp: "Formatted at 2026-08-08 05:03:37 on dist-test-slave-7kzw"
server_key: "e55d5bfa667bed4d3fb7f3f16a85de15"
server_key_iv: "53930de149c659f8502bead002ab2369"
server_key_version: "encryptionkey@0"
I20260808 05:03:37.103355 21329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:37.114758 21329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:37.117024 21329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:37.117132 21329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:37.122206 21329 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.252:39183
I20260808 05:03:37.122334 21423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.252:39183 every 8 connection(s)
I20260808 05:03:37.122637 21329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
I20260808 05:03:37.123775 21424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:37.124099 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 21329
I20260808 05:03:37.126279 21424 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165415, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.70.252@KRBTEST.COM
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.252@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:37.135298 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.124826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34584 (local address 127.11.70.252:39183)
0808 05:03:37.124982 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.125026 (+ 44us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.125060 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:03:37.125617 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.125624 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.125682 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.125835 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.126503 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.127770 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.128515 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.128933 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.129052 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.131648 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.131655 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.131656 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.131662 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.133566 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.133970 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.133973 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.133973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.134055 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.134329 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.134330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.134330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.134630 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.134799 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.134910 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.135076 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260808 05:03:37.135309 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.127159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50474 (local address 127.11.70.254:39095)
0808 05:03:37.127207 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.127210 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.127359 (+ 149us) server_negotiation.cc:407] Connection header received
0808 05:03:37.127432 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.127433 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.127444 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.127501 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.127989 (+ 488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.128497 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.129314 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.129517 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.129597 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.132326 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.132327 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.132328 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.132336 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.134047 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.134427 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.134429 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.134429 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.134505 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.134708 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.134709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.134710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.134831 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.134904 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.135125 (+ 221us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.135214 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:03:37.135329 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.126917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50474)
0808 05:03:37.127225 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.127278 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.127372 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.127530 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.127533 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.127828 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.127892 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.127895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.128612 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.128613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.129216 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.129218 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.129627 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.129629 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.129713 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.130199 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.130207 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.132232 (+ 2025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.134128 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.134135 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.134137 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.134349 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.134556 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.134557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.134558 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.134619 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.134909 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.134916 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.135000 (+ 84us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.135083 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.135211 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"mutex_wait_us":2,"thread_start_us":223,"threads_started":1}
I20260808 05:03:37.136183 21424 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.252@KRBTEST.COM for oryx/127.11.70.253@KRBTEST.COM
I20260808 05:03:37.142401 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.136482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.0.0.1:43386)
0808 05:03:37.136548 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.136561 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.136603 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.136724 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.136725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.136836 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.136894 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.136895 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.137495 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.137496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.137975 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.137976 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.138306 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.138307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.138357 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.138728 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.138732 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.139876 (+ 1144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.141506 (+ 1630us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.141507 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.141507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.141669 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.141844 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.141845 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.141845 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.141897 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.142176 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.142176 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.142213 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.142266 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.142338 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260808 05:03:37.142408 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.136575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43386 (local address 127.11.70.253:40563)
0808 05:03:37.136629 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.136631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.136638 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:37.136662 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.136663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.136674 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.136719 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.136956 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.137432 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.138047 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.138242 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.138293 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.139955 (+ 1662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.139956 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.139957 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.139963 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.141428 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.141741 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.141741 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.141742 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.141789 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.142023 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.142024 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.142024 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.142112 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.142157 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.142284 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.142347 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:03:37.142901 21424 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.252@KRBTEST.COM for oryx/127.11.70.252@KRBTEST.COM
I20260808 05:03:37.148507 21427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.143177 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.0.0.1:34592)
0808 05:03:37.143227 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.143239 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.143280 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.143393 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.143394 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.143500 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.143526 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.143527 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.144090 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.144091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.144560 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.144562 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.144885 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.144885 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.144923 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.145284 (+ 361us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.145290 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.146441 (+ 1151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.147730 (+ 1289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.147731 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.147731 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.147890 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.148064 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.148065 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.148065 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.148117 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.148303 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.148303 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.148332 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.148378 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.148449 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:03:37.148572 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.143232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34592 (local address 127.11.70.252:39183)
0808 05:03:37.143283 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.143285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.143306 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:03:37.143325 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.143326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.143341 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.143379 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.143583 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.144026 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.144627 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.144824 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.144873 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.146577 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.146578 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.146578 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.146584 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.147663 (+ 1079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.147956 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.147956 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.147957 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.148007 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.148162 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.148163 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.148163 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.148256 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.148300 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.148392 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.148494 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":33}
I20260808 05:03:37.149899 21424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Bootstrap starting.
I20260808 05:03:37.150938 21424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:37.151182 21424 log.cc:824] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:37.151890 21424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: No bootstrap required, opened a new log
I20260808 05:03:37.153327 21424 raft_consensus.cc:348] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } }
I20260808 05:03:37.153450 21424 raft_consensus.cc:374] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:37.153472 21424 raft_consensus.cc:729] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a51bf5cb8cd64e5e802ebe9b416c3bf2, State: Initialized, Role: FOLLOWER
I20260808 05:03:37.153597 21424 consensus_queue.cc:260] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } }
I20260808 05:03:37.153862 21429 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } } }
I20260808 05:03:37.153928 21424 sys_catalog.cc:564] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:37.153975 21429 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:03:37.155786 21446 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:03:37.155879 21446 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:03:37.158061 21329 master_runner.cc:428] Detected that this master a51bf5cb8cd64e5e802ebe9b416c3bf2 is joining an existing cluster
I20260808 05:03:37.158100 21329 master_runner.cc:432] Initiating AddMaster RPC to add 127.11.70.252:39183
I20260808 05:03:37.165838 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.159271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50482 (local address 127.11.70.254:39095)
0808 05:03:37.159432 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.159434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.159447 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:03:37.159538 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.159540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.159552 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.159613 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.160064 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.160561 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.161353 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.161563 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.161640 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.162998 (+ 1358us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.162999 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.162999 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.163005 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.164680 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.165011 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.165013 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.165013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.165077 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.165296 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.165297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.165297 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.165411 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.165482 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.165663 (+ 181us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.165736 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136}
I20260808 05:03:37.165867 21456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.159189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50482)
0808 05:03:37.159376 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.159386 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.159460 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.159619 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.159620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.159892 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.159980 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.159982 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.160644 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.160645 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.161251 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.161253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.161653 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.161654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.161734 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.162164 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.162169 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.162682 (+ 513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.164749 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.164750 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.164751 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.164934 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.165155 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.165156 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.165156 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.165222 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.165485 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.165487 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.165552 (+ 65us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.165636 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.165746 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":93,"threads_started":1}
I20260808 05:03:37.167709 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.159373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43396 (local address 127.11.70.253:40563)
0808 05:03:37.159442 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.159444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.159558 (+ 114us) server_negotiation.cc:407] Connection header received
0808 05:03:37.159659 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.159660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.159671 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.159701 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.160190 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.160956 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.162073 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.162396 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.162506 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.163502 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.163503 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.163504 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.163511 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.165313 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.165719 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.165720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.165720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.165778 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.166839 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.166841 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.166841 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.166994 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.167062 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.167511 (+ 449us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.167597 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:03:37.168381 21455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.159192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.0.0.1:43396)
0808 05:03:37.159499 (+ 307us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.159510 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.159569 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.159769 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.159770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.160022 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.160092 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.160093 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.161056 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.161057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.161977 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.161980 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.162510 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.162512 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.162578 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.163001 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.163007 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.163386 (+ 379us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.165406 (+ 2020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.165407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.165407 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.165617 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.165856 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.165856 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.165857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.166392 (+ 535us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.167332 (+ 940us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.167333 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.167378 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.168023 (+ 645us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.168274 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":292,"thread_start_us":120,"threads_started":1}
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165416, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.254@KRBTEST.COM for oryx/127.11.70.252@KRBTEST.COM
I20260808 05:03:37.187063 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 20472
I20260808 05:03:37.202229 21456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.167239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.0.0.1:34600)
0808 05:03:37.167479 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.167489 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.167536 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.167721 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.167732 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.167891 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.168577 (+ 686us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.168579 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.169501 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.169502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.170293 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.170296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.170758 (+ 462us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.170759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.170819 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.197155 (+ 26336us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.197162 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.199019 (+ 1857us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.201237 (+ 2218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.201237 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.201238 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.201432 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.201598 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.201599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.201599 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.201644 (+ 45us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.201921 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.201922 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.201957 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.202014 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.202120 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206}
I20260808 05:03:37.202349 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.168085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.0.0.1:34610)
0808 05:03:37.168130 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.168139 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.168178 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.168472 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.168473 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.168668 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.168705 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.168707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.169696 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.169697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.170197 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.170198 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.170710 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.170711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.170786 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.171126 (+ 340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.171132 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.172435 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.201042 (+ 28607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.201044 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.201045 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.201326 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.201588 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.201589 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.201590 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.201663 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.201968 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.201968 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.202020 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.202071 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.202198 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 05:03:37.202980 21426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.167270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34600 (local address 127.11.70.252:39183)
0808 05:03:37.167314 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.167316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.167608 (+ 292us) server_negotiation.cc:407] Connection header received
0808 05:03:37.167631 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.167631 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.167645 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.167688 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.168656 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.169413 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.170373 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.170661 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.170713 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.199129 (+ 28416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.199131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.199131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.199138 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.201148 (+ 2010us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.201499 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.201499 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.201500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.201542 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.201713 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.201714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.201714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.201843 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.201901 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.202779 (+ 878us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.202857 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:03:37.203053 21457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.168115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34610 (local address 127.11.70.252:39183)
0808 05:03:37.168291 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.168294 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.168301 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:37.168349 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.168350 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.168362 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.168773 (+ 411us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.168809 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.169619 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.170283 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.170631 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.170698 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.172544 (+ 1846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.172546 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.172546 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.172553 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.200926 (+ 28373us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.201431 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.201432 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.201433 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.201501 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.201746 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.201747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.201748 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.201890 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.202563 (+ 673us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.202679 (+ 116us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.202782 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260808 05:03:37.204213 20389 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.11.70.252:39183: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2"
member_type: NON_VOTER
last_known_addr {
host: "127.11.70.252"
port: 39183
}
attrs {
promote: true
}
}
dest_uuid: "6ebdad661391434fa59236ad37e2fb05"
cas_config_opid_index: 5
I20260808 05:03:37.204479 20389 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } }
I20260808 05:03:37.204741 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:34215
--local_ip_for_outbound_sockets=127.11.70.193
--tserver_master_addrs=127.11.70.254:39095
--webserver_port=35657
--webserver_interface=127.11.70.193
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab
--principal=oryx/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.70.254:39095,127.11.70.253:40563
--tserver_master_addrs=127.11.70.254:39095,127.11.70.253:40563,127.11.70.252:39183 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:03:37.204867 21195 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a51bf5cb8cd64e5e802ebe9b416c3bf2 (127.11.70.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.205071 21389 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:37.205884 21389 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 FOLLOWER]: Refusing update from remote peer 6ebdad661391434fa59236ad37e2fb05: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 05:03:37.206039 21195 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.11.70.252:39183
I20260808 05:03:37.206110 21195 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.206192 21195 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:37.206245 21195 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:37.206812 21329 master.cc:537] Master@127.11.70.252:39183 shutting down...
I20260808 05:03:37.207597 21389 raft_consensus.cc:858] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } }
W20260808 05:03:37.207690 21389 raft_consensus.cc:1565] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 6' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } }.
Pending config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } }:
New config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } }
I20260808 05:03:37.208838 21389 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER dfdcc0ad4ed9486da87c2cd6bb0de50f (127.11.70.253) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } }
I20260808 05:03:37.210187 21462 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } }
I20260808 05:03:37.210294 21429 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ebdad661391434fa59236ad37e2fb05. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } }
I20260808 05:03:37.211546 21429 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 05:03:37.211609 21429 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } }
I20260808 05:03:37.211673 21429 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 05:03:37.211535 21462 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: This master's current role is: NON_PARTICIPANT
I20260808 05:03:37.212062 21196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.212158 21196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:37.212801 21460 mvcc.cc:205] Tried to move back new op lower bound from 7316133544485322752 to 7316133544380366848. Current Snapshot: MvccSnapshot[applied={T|T < 7316133544392151040}]
I20260808 05:03:37.212960 21329 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 NON_PARTICIPANT]: Raft consensus shutting down.
I20260808 05:03:37.213040 21329 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 NON_PARTICIPANT]: Raft consensus is shut down!
I20260808 05:03:37.213078 21329 tablet_replica.cc:330] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: stopping tablet replica
W20260808 05:03:37.213250 20369 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 -> Peer a51bf5cb8cd64e5e802ebe9b416c3bf2 (127.11.70.252:39183): Couldn't send request to peer a51bf5cb8cd64e5e802ebe9b416c3bf2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 05:03:37.213647 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.206565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.0.0.1:43410)
0808 05:03:37.207727 (+ 1162us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.207741 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.207796 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.208272 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.208273 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.208275 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:37.208321 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.208322 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.210426 (+ 2104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.210427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.211744 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.211746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.213350 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.213351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.213420 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.213442 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.213524 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.213581 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1143}
I20260808 05:03:37.213708 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.206739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43410 (local address 127.11.70.253:40563)
0808 05:03:37.206798 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.206800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.208080 (+ 1280us) server_negotiation.cc:407] Connection header received
0808 05:03:37.208113 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.208114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.208140 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.208208 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:37.208392 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.209180 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.211851 (+ 2671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.212460 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.212533 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.212607 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.213556 (+ 949us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.213612 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:03:37.213948 21269 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 LEARNER]: Refusing update from remote peer 6ebdad661391434fa59236ad37e2fb05: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 05:03:37.214143 21459 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 05:03:37.214804 21269 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER a51bf5cb8cd64e5e802ebe9b416c3bf2 (127.11.70.252) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.216507 21304 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ebdad661391434fa59236ad37e2fb05. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.216609 21304 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: This master's current role is: LEARNER
I20260808 05:03:37.216648 21304 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: NON_VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: true } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.216708 21304 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: This master's current role is: LEARNER
I20260808 05:03:37.216959 21459 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: attempting to promote NON_VOTER dfdcc0ad4ed9486da87c2cd6bb0de50f to VOTER
I20260808 05:03:37.217137 21459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } }
I20260808 05:03:37.217641 21269 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 LEARNER]: Refusing update from remote peer 6ebdad661391434fa59236ad37e2fb05: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 05:03:37.217689 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.217558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.0.0.1:34624)
0808 05:03:37.217598 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.217653 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:39183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 05:03:37.218029 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.217906 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.0.0.1:34628)
0808 05:03:37.217964 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.217997 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:39183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 05:03:37.218034 21195 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260808 05:03:37.218235 20369 consensus_peers.cc:487] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 -> Peer a51bf5cb8cd64e5e802ebe9b416c3bf2 (127.11.70.252:39183): Couldn't send request to peer a51bf5cb8cd64e5e802ebe9b416c3bf2. Status: Network error: Client connection negotiation failed: client connection to 127.11.70.252:39183: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 05:03:37.218739 21196 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, dfdcc0ad4ed9486da87c2cd6bb0de50f (127.11.70.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.219596 21196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.219686 21196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:37.219736 21196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.219784 21196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:37.220027 21269 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, dfdcc0ad4ed9486da87c2cd6bb0de50f (127.11.70.253) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.220984 21469 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.221079 21469 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:03:37.227758 21329 master.cc:552] Master@127.11.70.252:39183 shutdown complete.
I20260808 05:03:37.227807 21329 master_runner.cc:305] Clearing existing system tablet
I20260808 05:03:37.227941 21329 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:37.227990 21329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:37.228726 21329 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.001s
I20260808 05:03:37.229306 21472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.229456 21329 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:37.229506 21329 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.229527 21329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal
uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2"
format_stamp: "Formatted at 2026-08-08 05:03:37 on dist-test-slave-7kzw"
server_key: "e55d5bfa667bed4d3fb7f3f16a85de15"
server_key_iv: "53930de149c659f8502bead002ab2369"
server_key_version: "encryptionkey@0"
I20260808 05:03:37.230211 21329 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:37.231609 21329 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 05:03:37.231685 21329 log.cc:1196] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 05:03:37.231920 21329 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Deleting consensus metadata
I20260808 05:03:37.232040 21329 master_runner.cc:315] Copying system tablet from 127.11.70.254:39095
I20260808 05:03:37.232649 21329 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: tablet copy: Beginning tablet copy session from remote peer at address 127.11.70.254:39095
I20260808 05:03:37.240051 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.232989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50494 (local address 127.11.70.254:39095)
0808 05:03:37.233030 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.233032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.233167 (+ 135us) server_negotiation.cc:407] Connection header received
0808 05:03:37.233227 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.233228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.233240 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.233280 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.233669 (+ 389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.234427 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.235435 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.235768 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.235837 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.237017 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.237019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.237019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.237027 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.238771 (+ 1744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.239166 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.239168 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.239168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.239245 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.239467 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.239467 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.239468 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.239611 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.239678 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.239878 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.239958 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:03:37.240379 21485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.232919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50494)
0808 05:03:37.233081 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.233092 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.233159 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.233306 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.233306 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.233524 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.233582 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.233584 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.234545 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.234547 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.235340 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.235342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.235902 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.235903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.235971 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.236486 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.236492 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.236925 (+ 433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.238855 (+ 1930us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.238856 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.238857 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.239085 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.239323 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.239324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.239324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.239396 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.239710 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.239711 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.239762 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.240162 (+ 400us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.240285 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":66,"threads_started":1}
I20260808 05:03:37.240682 20414 tablet_copy_service.cc:140] P 6ebdad661391434fa59236ad37e2fb05: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a51bf5cb8cd64e5e802ebe9b416c3bf2 ({username='oryx', principal='oryx/127.11.70.252@KRBTEST.COM'} at 127.0.0.1:50494)
I20260808 05:03:37.240751 20414 tablet_copy_service.cc:161] P 6ebdad661391434fa59236ad37e2fb05: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a51bf5cb8cd64e5e802ebe9b416c3bf2 at {username='oryx', principal='oryx/127.11.70.252@KRBTEST.COM'} at 127.0.0.1:50494: session id = a51bf5cb8cd64e5e802ebe9b416c3bf2-00000000000000000000000000000000
I20260808 05:03:37.241345 20414 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 05:03:37.241822 21329 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 05:03:37.243090 21329 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: tablet copy: Starting download of 0 data blocks...
I20260808 05:03:37.243247 21329 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: tablet copy: Starting download of 1 WAL segments...
I20260808 05:03:37.244105 21329 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 05:03:37.244997 20414 tablet_copy_service.cc:342] P 6ebdad661391434fa59236ad37e2fb05: Request end of tablet copy session a51bf5cb8cd64e5e802ebe9b416c3bf2-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.11.70.252@KRBTEST.COM'} at 127.0.0.1:50494
I20260808 05:03:37.245061 20414 tablet_copy_service.cc:433] P 6ebdad661391434fa59236ad37e2fb05: ending tablet copy session a51bf5cb8cd64e5e802ebe9b416c3bf2-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a51bf5cb8cd64e5e802ebe9b416c3bf2
I20260808 05:03:37.247841 21329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:37.249080 21487 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:37.249128 21490 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:37.249269 21488 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:37.249394 21329 server_base.cc:1034] running on GCE node
I20260808 05:03:37.249578 21329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:37.249738 21329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:37.250873 21329 hybrid_clock.cc:648] HybridClock initialized: now 1786165417250859 us; error 30 us; skew 500 ppm
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:37.252380 21329 init.cc:377] Logged in from keytab as oryx/127.11.70.252@KRBTEST.COM (short username oryx)
I20260808 05:03:37.252665 21329 webserver.cc:460] Webserver started at http://127.11.70.252:38647/ using document root <none> and password file <none>
I20260808 05:03:37.252792 21329 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:37.252835 21329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:37.253645 21329 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:37.254276 21500 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.254492 21329 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:37.254551 21329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal
uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2"
format_stamp: "Formatted at 2026-08-08 05:03:37 on dist-test-slave-7kzw"
server_key: "e55d5bfa667bed4d3fb7f3f16a85de15"
server_key_iv: "53930de149c659f8502bead002ab2369"
server_key_version: "encryptionkey@0"
I20260808 05:03:37.254613 21329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:37.268499 21329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:37.270431 21329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:37.273844 21329 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.252:39183
I20260808 05:03:37.274252 21578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.252:39183 every 8 connection(s)
I20260808 05:03:37.274278 21329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
I20260808 05:03:37.275292 21585 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:03:37.275795 21585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Bootstrap starting.
I20260808 05:03:37.278159 21585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:03:37.278414 21585 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Bootstrap complete.
I20260808 05:03:37.278640 21585 raft_consensus.cc:348] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } }
I20260808 05:03:37.278743 21585 raft_consensus.cc:729] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a51bf5cb8cd64e5e802ebe9b416c3bf2, State: Initialized, Role: LEARNER
I20260808 05:03:37.278785 21585 consensus_queue.cc:260] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } }
I20260808 05:03:37.278962 21585 sys_catalog.cc:564] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:37.278965 21591 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.279248 21591 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: This master's current role is: LEARNER
I20260808 05:03:37.280998 21606 catalog_manager.cc:1259] Loaded cluster ID: 6fd2726a373d45cf8be486c4da27b8d2
I20260808 05:03:37.281096 21606 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: loading cluster ID for follower catalog manager: success
I20260808 05:03:37.282212 21606 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: acquiring CA information for follower catalog manager: success
I20260808 05:03:37.282547 21606 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260808 05:03:37.312597 21458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:37.312847 21458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:37.312891 21458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:37.314064 21458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:37.314131 21458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:37.314177 21458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:37.315800 21458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab
--principal=oryx/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:34215
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=35657
--tserver_master_addrs=127.11.70.254:39095,127.11.70.253:40563,127.11.70.252:39183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:37.316082 21458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:37.316339 21458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:37.321792 21614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:37.321841 21617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:37.322052 21458 server_base.cc:1034] running on GCE node
W20260808 05:03:37.321807 21615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:37.322340 21458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:37.322657 21458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:37.323827 21458 hybrid_clock.cc:648] HybridClock initialized: now 1786165417323808 us; error 33 us; skew 500 ppm
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:37.326750 21458 init.cc:377] Logged in from keytab as oryx/127.11.70.193@KRBTEST.COM (short username oryx)
I20260808 05:03:37.327193 21458 webserver.cc:460] Webserver started at http://127.11.70.193:35657/ using document root <none> and password file <none>
I20260808 05:03:37.327457 21458 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:37.327544 21458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:37.328920 21458 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:03:37.329506 21628 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.329697 21458 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:37.329802 21458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "c208a29c7a214f9abe84ae90c0a836bf"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "5fe288a2ecaf33738f21f5fc0e08eeba"
server_key_iv: "ab9db1d0aacf5270d360c48d4c5d5f32"
server_key_version: "encryptionkey@0"
I20260808 05:03:37.330147 21458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:37.339989 21458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:37.341758 21458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:37.341917 21458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:37.342139 21458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:37.342438 21458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:37.342562 21458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.342599 21458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:37.342621 21458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.349354 21458 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:34215
I20260808 05:03:37.349411 21792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:34215 every 8 connection(s)
I20260808 05:03:37.349771 21458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:37.354948 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 21458
I20260808 05:03:37.355109 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 20663
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.252@KRBTEST.COM
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.253@KRBTEST.COM
I20260808 05:03:37.362409 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.350836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:34317 (local address 127.11.70.254:39095)
0808 05:03:37.350899 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.350900 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.350911 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:37.351932 (+ 1021us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.351934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.351948 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.351982 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.352746 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.353254 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.354629 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.354949 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.354992 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.358159 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.358161 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.358162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.358172 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.360645 (+ 2473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.361270 (+ 625us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.361271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.361272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.361344 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.361659 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.361660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.361660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.361795 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.361839 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.362232 (+ 393us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.362317 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:03:37.362872 21804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.350512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.193:34317)
0808 05:03:37.350799 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.350812 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.351799 (+ 987us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.352095 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.352100 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.352441 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.352634 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.352640 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.353352 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.353352 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.354530 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.354532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.355117 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.355118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.355310 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.356003 (+ 693us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.356013 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.358044 (+ 2031us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.360758 (+ 2714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.360768 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.360770 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.361176 (+ 406us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.361421 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.361422 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.361422 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.361575 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.361889 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.361892 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.362057 (+ 165us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.362585 (+ 528us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.362674 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":24,"thread_start_us":94,"threads_started":1}
I20260808 05:03:37.363363 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.350665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:40051 (local address 127.11.70.252:39183)
0808 05:03:37.350851 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.350853 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.351045 (+ 192us) server_negotiation.cc:407] Connection header received
0808 05:03:37.351913 (+ 868us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.351914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.351928 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.352017 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.353877 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.354626 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.355921 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.356351 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.356423 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.358944 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.358945 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.358945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.358953 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.360769 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.361270 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.361271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.361272 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.361344 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.361653 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.361654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.361654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.361790 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.361854 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.363147 (+ 1293us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.363262 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":60,"threads_started":1}
I20260808 05:03:37.363353 21794 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39095
I20260808 05:03:37.363448 21794 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:37.363605 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.350591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:47957 (local address 127.11.70.253:40563)
0808 05:03:37.350746 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.350749 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.350892 (+ 143us) server_negotiation.cc:407] Connection header received
0808 05:03:37.351932 (+ 1040us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.351934 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.351947 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.351982 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.353341 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.353794 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.354742 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.355040 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.355080 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.359760 (+ 4680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.359762 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.359762 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.359771 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.361896 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.362418 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.362419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.362420 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.362534 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.362820 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.362821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.362821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.363019 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.363085 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.363344 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.363453 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260808 05:03:37.363646 21794 heartbeater.cc:511] Master 127.11.70.254:39095 requested a full tablet report, sending...
I20260808 05:03:37.362872 21805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.350511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.11.70.193:40051)
0808 05:03:37.350965 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.350980 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.351808 (+ 828us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.352104 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.352105 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.352443 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.352633 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.352637 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.354706 (+ 2069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.354707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.355810 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.355814 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.356489 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.356490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.356569 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.356964 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.356971 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.358839 (+ 1868us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.360851 (+ 2012us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.360852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.360853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.361176 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.361418 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.361419 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.361419 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.361575 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.361884 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.361891 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.362083 (+ 192us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.362182 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.362350 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"mutex_wait_us":34,"spinlock_wait_cycles":11008,"thread_start_us":93,"threads_started":1}
I20260808 05:03:37.364063 20389 ts_manager.cc:194] Re-registered known tserver with Master: c208a29c7a214f9abe84ae90c0a836bf (127.11.70.193:34215)
I20260808 05:03:37.364331 21803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.350510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.11.70.193:47957)
0808 05:03:37.350767 (+ 257us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.350813 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.351799 (+ 986us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.352095 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.352100 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.352460 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.352634 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.352640 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.353875 (+ 1235us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.353876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.354649 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.354650 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.355153 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.355153 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.355290 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.357684 (+ 2394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.357689 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.359620 (+ 1931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.362005 (+ 2385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.362006 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.362007 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.362305 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.362628 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.362628 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.362629 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.362727 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.363128 (+ 401us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.363129 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.363184 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.363775 (+ 591us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.363911 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":218,"mutex_wait_us":23,"thread_start_us":86,"threads_started":1}
I20260808 05:03:37.364444 20389 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:34317
I20260808 05:03:37.364784 21793 heartbeater.cc:347] Connected to a master server at 127.11.70.252:39183
I20260808 05:03:37.364830 21793 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:37.364923 21793 heartbeater.cc:511] Master 127.11.70.252:39183 requested a full tablet report, sending...
I20260808 05:03:37.365298 21526 ts_manager.cc:194] Registered new tserver with Master: c208a29c7a214f9abe84ae90c0a836bf (127.11.70.193:34215)
I20260808 05:03:37.376348 21800 heartbeater.cc:347] Connected to a master server at 127.11.70.253:40563
I20260808 05:03:37.376425 21800 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:37.376503 21800 heartbeater.cc:511] Master 127.11.70.253:40563 requested a full tablet report, sending...
I20260808 05:03:37.376917 21257 ts_manager.cc:194] Registered new tserver with Master: c208a29c7a214f9abe84ae90c0a836bf (127.11.70.193:34215)
I20260808 05:03:37.380913 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:37021
--local_ip_for_outbound_sockets=127.11.70.194
--tserver_master_addrs=127.11.70.254:39095
--webserver_port=33853
--webserver_interface=127.11.70.194
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab
--principal=oryx/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.70.254:39095,127.11.70.253:40563
--tserver_master_addrs=127.11.70.254:39095,127.11.70.253:40563,127.11.70.252:39183 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:37.463945 21808 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:37.464156 21808 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:37.464179 21808 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:37.465329 21808 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:37.465371 21808 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:37.465396 21808 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:37.466873 21808 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab
--principal=oryx/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:37021
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=33853
--tserver_master_addrs=127.11.70.254:39095,127.11.70.253:40563,127.11.70.252:39183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:37.467128 21808 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:37.467391 21808 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:37.472661 21815 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:37.472755 21816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:37.472648 21819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:37.472908 21808 server_base.cc:1034] running on GCE node
I20260808 05:03:37.473097 21808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:37.473299 21808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:37.474443 21808 hybrid_clock.cc:648] HybridClock initialized: now 1786165417474423 us; error 35 us; skew 500 ppm
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:37.477054 21808 init.cc:377] Logged in from keytab as oryx/127.11.70.194@KRBTEST.COM (short username oryx)
I20260808 05:03:37.477506 21808 webserver.cc:460] Webserver started at http://127.11.70.194:33853/ using document root <none> and password file <none>
I20260808 05:03:37.477684 21808 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:37.477733 21808 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:37.479141 21808 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 05:03:37.479760 21829 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.479943 21808 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.480067 21808 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "110aa8a723ee413abbe59cb435f2ac6c"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "dd4b51500e17e526a73cacc7fee17b2e"
server_key_iv: "06431a6b6c80d075554768bc339cb355"
server_key_version: "encryptionkey@0"
I20260808 05:03:37.480443 21808 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:37.505455 21808 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:37.507975 21808 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:37.508147 21808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:37.508399 21808 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:37.508721 21808 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:37.508778 21808 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.508823 21808 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:37.508860 21808 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.515362 21808 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:37021
I20260808 05:03:37.515408 21992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:37021 every 8 connection(s)
I20260808 05:03:37.515790 21808 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:37.516181 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 21808
I20260808 05:03:37.516343 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 20873
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.253@KRBTEST.COM
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.252@KRBTEST.COM
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:37.531893 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:39115
--local_ip_for_outbound_sockets=127.11.70.195
--tserver_master_addrs=127.11.70.254:39095
--webserver_port=44045
--webserver_interface=127.11.70.195
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab
--principal=oryx/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:46181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.11.70.254:39095,127.11.70.253:40563
--tserver_master_addrs=127.11.70.254:39095,127.11.70.253:40563,127.11.70.252:39183 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:03:37.534286 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.521020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:57089 (local address 127.11.70.253:40563)
0808 05:03:37.521070 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.521072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.522703 (+ 1631us) server_negotiation.cc:407] Connection header received
0808 05:03:37.522814 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.522815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.522829 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.522860 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.524305 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.525345 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.527045 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.527387 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.527431 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.530660 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.530662 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.530662 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.530671 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.532548 (+ 1877us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.533073 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.533075 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.533075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.533140 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.533466 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.533467 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.533467 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.533618 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.533684 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.534066 (+ 382us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.534162 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:37.535048 22002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.519986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.11.70.194:57089)
0808 05:03:37.522619 (+ 2633us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.522632 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.522735 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.523012 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.523016 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.523683 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.524106 (+ 423us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.524116 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.525481 (+ 1365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.525482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.526933 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.526936 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.527527 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.527528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.527684 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.528269 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.528281 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.530488 (+ 2207us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.532639 (+ 2151us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.532647 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.532649 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.532982 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.533235 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.533235 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.533236 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.533378 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.533722 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.533729 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.533900 (+ 171us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.534428 (+ 528us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.534766 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2612,"thread_start_us":909,"threads_started":1}
I20260808 05:03:37.535567 22000 heartbeater.cc:347] Connected to a master server at 127.11.70.253:40563
I20260808 05:03:37.535678 22000 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:37.535862 22005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.516573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.11.70.194:42465)
0808 05:03:37.521160 (+ 4587us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.521207 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.521850 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.525688 (+ 3838us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.525689 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.525900 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.525990 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.525992 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.527203 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.527204 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.528386 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.528388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.528915 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.528916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.528979 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.529443 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.529725 (+ 282us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.531907 (+ 2182us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.534459 (+ 2552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.534489 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.534489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.534863 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.535091 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.535092 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.535092 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.535150 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.535446 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.535447 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.535492 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.535550 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.535647 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4538,"thread_start_us":86,"threads_started":1}
I20260808 05:03:37.535933 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.523000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:42465 (local address 127.11.70.252:39183)
0808 05:03:37.523085 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.523088 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.523099 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:37.523129 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.523130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.523146 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.523218 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.526300 (+ 3082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.527118 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.528474 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.528810 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.528866 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.532017 (+ 3151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.532019 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.532019 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.532027 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.533886 (+ 1859us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.534954 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.534955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.534955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.535021 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.535220 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.535220 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.535221 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.535353 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.535417 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.535753 (+ 336us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.535840 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:03:37.535935 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.526144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:35921 (local address 127.11.70.254:39095)
0808 05:03:37.526205 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.526207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.526392 (+ 185us) server_negotiation.cc:407] Connection header received
0808 05:03:37.526500 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.526502 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.526513 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.526545 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.527047 (+ 502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.527846 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.528833 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.529134 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.529191 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.532351 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.532352 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.532352 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.532360 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.534336 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.534993 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.534994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.534994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.535060 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.535308 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.535309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.535309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.535446 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.535492 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.535742 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.535826 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:03:37.535902 22000 heartbeater.cc:511] Master 127.11.70.253:40563 requested a full tablet report, sending...
I20260808 05:03:37.536273 22007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.526073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.194:35921)
0808 05:03:37.526339 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.526348 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.526415 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.526608 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.526609 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.526781 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.526946 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.526948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.527952 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.527953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.528741 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.528743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.529274 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.529275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.529342 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.529751 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.529757 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.532224 (+ 2467us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.534571 (+ 2347us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.534572 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.534572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.534898 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.535144 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.535144 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.535145 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.535217 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.535542 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.535542 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.535586 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.536051 (+ 465us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.536173 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":249,"thread_start_us":73,"threads_started":1}
I20260808 05:03:37.537657 21257 ts_manager.cc:194] Registered new tserver with Master: 110aa8a723ee413abbe59cb435f2ac6c (127.11.70.194:37021)
I20260808 05:03:37.537925 21995 heartbeater.cc:347] Connected to a master server at 127.11.70.252:39183
I20260808 05:03:37.537981 21995 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:37.538055 21995 heartbeater.cc:511] Master 127.11.70.252:39183 requested a full tablet report, sending...
I20260808 05:03:37.538239 21998 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39095
I20260808 05:03:37.538298 21998 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:37.538371 21998 heartbeater.cc:511] Master 127.11.70.254:39095 requested a full tablet report, sending...
I20260808 05:03:37.538359 21526 ts_manager.cc:194] Registered new tserver with Master: 110aa8a723ee413abbe59cb435f2ac6c (127.11.70.194:37021)
I20260808 05:03:37.538739 20389 ts_manager.cc:194] Re-registered known tserver with Master: 110aa8a723ee413abbe59cb435f2ac6c (127.11.70.194:37021)
I20260808 05:03:37.539281 20389 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:35921
I20260808 05:03:37.597847 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.594808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.0.0.1:34636)
0808 05:03:37.594867 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.594882 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.594955 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.595141 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.595142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.595144 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:37.595193 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.595194 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.596144 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.596146 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.596852 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.596854 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.597660 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.597661 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.597705 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.597709 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.597750 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.597783 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 05:03:37.597894 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.594897 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34636 (local address 127.11.70.252:39183)
0808 05:03:37.594979 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.594982 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.594995 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:03:37.595027 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.595028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.595057 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.595129 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:37.595264 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.596063 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.596945 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.597573 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.597667 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.597757 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.597780 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.597819 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:03:37.598291 21539 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 05:03:37.598438 21591 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ebdad661391434fa59236ad37e2fb05. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.598601 21591 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: This master's current role is: LEARNER
W20260808 05:03:37.619727 22008 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:37.619923 22008 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:37.619947 22008 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:37.620990 22008 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:37.621026 22008 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:37.621052 22008 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:37.622447 22008 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:46181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab
--principal=oryx/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:39115
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=44045
--tserver_master_addrs=127.11.70.254:39095,127.11.70.253:40563,127.11.70.252:39183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22008
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:37.622745 22008 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:37.622969 22008 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:37.628155 22016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:37.628170 22018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:37.628172 22014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:37.628386 22008 server_base.cc:1034] running on GCE node
I20260808 05:03:37.628638 22008 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:37.628886 22008 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:37.630052 22008 hybrid_clock.cc:648] HybridClock initialized: now 1786165417630046 us; error 37 us; skew 500 ppm
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:37.632719 22008 init.cc:377] Logged in from keytab as oryx/127.11.70.195@KRBTEST.COM (short username oryx)
I20260808 05:03:37.633205 22008 webserver.cc:460] Webserver started at http://127.11.70.195:44045/ using document root <none> and password file <none>
I20260808 05:03:37.633461 22008 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:37.633517 22008 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:37.634868 22008 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:37.635466 22028 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.635673 22008 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:37.635757 22008 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "eb940d57f34b4f92b9a47ba469e6fcb4"
format_stamp: "Formatted at 2026-08-08 05:03:36 on dist-test-slave-7kzw"
server_key: "378cfe2b5f8b9922352fd7a5682eaa08"
server_key_iv: "1901337666c7fca8e4b519e7427939d2"
server_key_version: "encryptionkey@0"
I20260808 05:03:37.636088 22008 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:37.646979 22008 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:37.648921 22008 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:37.649080 22008 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:37.649294 22008 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:37.649618 22008 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:37.649674 22008 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.649717 22008 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:37.649744 22008 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:37.655824 22008 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:39115
I20260808 05:03:37.655893 22206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:39115 every 8 connection(s)
I20260808 05:03:37.656246 22008 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:03:37.659684 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 22008
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.252@KRBTEST.COM
I20260808 05:03:37.672212 22229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.662366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43414 (local address 127.11.70.253:40563)
0808 05:03:37.662697 (+ 331us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.662700 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.663463 (+ 763us) server_negotiation.cc:407] Connection header received
0808 05:03:37.663492 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.663493 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.663508 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.663568 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.664205 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.664982 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.666047 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.666363 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.666710 (+ 347us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.667977 (+ 1267us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.667979 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.667979 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.667986 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.670538 (+ 2552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.671006 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.671007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.671008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.671070 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.671312 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.671313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.671313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.671458 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.671946 (+ 488us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.671989 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.672075 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":67,"threads_started":1}
Aug 08 05:03:37 dist-test-slave-7kzw krb5kdc[20324](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165417, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.253@KRBTEST.COM
I20260808 05:03:37.674189 22214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.656965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.195:40023)
0808 05:03:37.657156 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.657199 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.658242 (+ 1043us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.658541 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.658547 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.658918 (+ 371us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.659107 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.659113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.660084 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.660085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.662177 (+ 2092us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.662180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.662804 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.662806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.662890 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.666399 (+ 3509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.666410 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.669522 (+ 3112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.672281 (+ 2759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.672291 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.672293 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.672623 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.672869 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.672870 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.672870 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.673028 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.673427 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.673435 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.673609 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.673735 (+ 126us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.673908 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":1195,"thread_start_us":114,"threads_started":1}
I20260808 05:03:37.674830 20443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.656962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:40023 (local address 127.11.70.254:39095)
0808 05:03:37.657248 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.657250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.657264 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:03:37.658372 (+ 1108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.658373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.658386 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.658421 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.659225 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.659982 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.662316 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.662665 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.662715 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.669627 (+ 6912us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.669628 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.669629 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.669639 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.672161 (+ 2522us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.672718 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.672719 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.672720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.672794 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.673122 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.673124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.673124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.673273 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.673334 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.674654 (+ 1320us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.674742 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260}
I20260808 05:03:37.675261 22216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.656966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.11.70.195:56199)
0808 05:03:37.657316 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.657325 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.658252 (+ 927us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.658547 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.658548 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.658926 (+ 378us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.659107 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.659113 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.660166 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.660167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.661409 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.661412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.661908 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.661909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.662175 (+ 266us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.666558 (+ 4383us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.666564 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.671778 (+ 5214us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.674097 (+ 2319us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.674097 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.674098 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.674308 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.674570 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.674571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.674571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.674631 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.674932 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.674933 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.674984 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.675044 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.675142 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":328,"mutex_wait_us":91,"thread_start_us":98,"threads_started":1}
I20260808 05:03:37.675359 22208 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39095
I20260808 05:03:37.675450 22208 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:37.675560 22226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.660768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50510 (local address 127.11.70.254:39095)
0808 05:03:37.660917 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.660918 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.662821 (+ 1903us) server_negotiation.cc:407] Connection header received
0808 05:03:37.662908 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.662909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.662923 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.662989 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.663861 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.665194 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.667575 (+ 2381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.669309 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.669661 (+ 352us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.670934 (+ 1273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.670935 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.670936 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.670943 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.673687 (+ 2744us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.674097 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.674098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.674099 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.674160 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.674403 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.674404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.674404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.674590 (+ 186us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.675312 (+ 722us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.675356 (+ 44us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.675440 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":93,"threads_started":1}
I20260808 05:03:37.675618 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.657271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:56199 (local address 127.11.70.252:39183)
0808 05:03:37.657312 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.657314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.657374 (+ 60us) server_negotiation.cc:407] Connection header received
0808 05:03:37.658372 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.658373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.658391 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.658423 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.659229 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.659986 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.661513 (+ 1527us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.661813 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.661880 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.671877 (+ 9997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.671878 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.671879 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.671887 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.674012 (+ 2125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.674395 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.674396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.674396 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.674502 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.674713 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.674714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.674715 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.674841 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.674901 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.675449 (+ 548us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.675532 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:37.675635 22208 heartbeater.cc:511] Master 127.11.70.254:39095 requested a full tablet report, sending...
I20260808 05:03:37.675917 22207 heartbeater.cc:347] Connected to a master server at 127.11.70.252:39183
I20260808 05:03:37.675966 22207 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:37.676038 22207 heartbeater.cc:511] Master 127.11.70.252:39183 requested a full tablet report, sending...
I20260808 05:03:37.676308 21526 ts_manager.cc:194] Registered new tserver with Master: eb940d57f34b4f92b9a47ba469e6fcb4 (127.11.70.195:39115)
I20260808 05:03:37.676343 20389 ts_manager.cc:194] Re-registered known tserver with Master: eb940d57f34b4f92b9a47ba469e6fcb4 (127.11.70.195:39115)
I20260808 05:03:37.676638 22215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.656966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.11.70.195:50543)
0808 05:03:37.657439 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.657450 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.658255 (+ 805us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.658551 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.658557 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.658888 (+ 331us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:37.659106 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.659111 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.660014 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.660015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.661409 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.661412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.668915 (+ 7503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.668916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.668996 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.669956 (+ 960us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:37.669961 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:37.673598 (+ 3637us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:37.675533 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.675534 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.675535 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.675765 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.675972 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:37.675972 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:37.675973 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:37.676034 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:37.676330 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:37.676331 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:37.676373 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.676438 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.676533 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":106,"spinlock_wait_cycles":6528,"thread_start_us":99,"threads_started":1}
I20260808 05:03:37.676800 20389 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:40023
I20260808 05:03:37.677006 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.657263 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:50543 (local address 127.11.70.253:40563)
0808 05:03:37.657308 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.657311 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.657523 (+ 212us) server_negotiation.cc:407] Connection header received
0808 05:03:37.658350 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.658351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.658364 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.658429 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.659209 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.659863 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.667873 (+ 8010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.668151 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.668223 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.673716 (+ 5493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.673717 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.673718 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.673736 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.675448 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.675841 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.675842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.675842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.675902 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.676104 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.676105 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.676105 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.676238 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.676300 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.676829 (+ 529us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.676913 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:03:37.677680 22212 heartbeater.cc:347] Connected to a master server at 127.11.70.253:40563
I20260808 05:03:37.677752 22212 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:37.677827 22212 heartbeater.cc:511] Master 127.11.70.253:40563 requested a full tablet report, sending...
I20260808 05:03:37.678119 21257 ts_manager.cc:194] Registered new tserver with Master: eb940d57f34b4f92b9a47ba469e6fcb4 (127.11.70.195:39115)
I20260808 05:03:37.678275 20389 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50510:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:37.680485 20389 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:37.681254 21459 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: NON_VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: true } } }
I20260808 05:03:37.681365 21459 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:37.682245 21459 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: attempting to promote NON_VOTER a51bf5cb8cd64e5e802ebe9b416c3bf2 to VOTER
I20260808 05:03:37.682376 21459 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } }
I20260808 05:03:37.682772 22236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.663277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34640 (local address 127.11.70.252:39183)
0808 05:03:37.663892 (+ 615us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.663894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.664348 (+ 454us) server_negotiation.cc:407] Connection header received
0808 05:03:37.664370 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.664371 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.664382 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.664436 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.665098 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.665837 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.677101 (+ 11264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.677389 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.677472 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.679527 (+ 2055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.679528 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.679528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.679534 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.681399 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.681777 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.681778 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.681778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.681845 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.682064 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.682065 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.682065 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.682209 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.682309 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.682427 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.682546 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":114,"threads_started":1}
I20260808 05:03:37.682914 21269 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Refusing update from remote peer 6ebdad661391434fa59236ad37e2fb05: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 05:03:37.683070 21539 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 LEARNER]: Refusing update from remote peer 6ebdad661391434fa59236ad37e2fb05: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 05:03:37.683102 21195 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 05:03:37.683220 21195 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260808 05:03:37.683996 21196 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a51bf5cb8cd64e5e802ebe9b416c3bf2 (127.11.70.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:37.684103 21539 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a51bf5cb8cd64e5e802ebe9b416c3bf2 (127.11.70.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:37.684211 21269 raft_consensus.cc:2932] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, a51bf5cb8cd64e5e802ebe9b416c3bf2 (127.11.70.252) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:37.684993 21196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:37.685024 21591 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:37.685081 21196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:37.685105 21591 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:03:37.685144 21196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:37.685220 21196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:37.685185 21469 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:37.685264 21469 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:03:37.685258 21196 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6ebdad661391434fa59236ad37e2fb05" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:37.685303 21196 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:37.690779 21194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.687160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:39115 (local address 127.0.0.1:37998)
0808 05:03:37.687203 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.687216 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.687286 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.687671 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.687672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.687675 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:37.687725 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.687726 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.688809 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.688810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.689622 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.689624 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.690551 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.690552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.690611 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.690616 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.690678 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.690715 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 05:03:37.690814 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.687314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37998 (local address 127.11.70.195:39115)
0808 05:03:37.687484 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.687489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.687501 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:03:37.687537 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.687539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.687555 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.687666 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:37.687800 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.688732 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.689708 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.690441 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.690552 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.690609 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.690691 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.690736 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":92,"threads_started":1}
I20260808 05:03:37.691469 22102 tablet_service.cc:1467] Processing CreateTablet for tablet 1d5cfcf68d944a83aa2ddd94cc5bf761 (DEFAULT_TABLE table=test-table [id=9120549e70a14cd7bab7cc20d9a6957d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:37.691802 22246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.687171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:34215 (local address 127.0.0.1:39198)
0808 05:03:37.687908 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.687916 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.687990 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.688259 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.688260 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.688262 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:37.688332 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.688333 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.689586 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.689587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.690583 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.690585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.691561 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.691562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.691624 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.691628 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.691693 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.691730 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":718,"mutex_wait_us":24,"thread_start_us":98,"threads_started":1}
I20260808 05:03:37.691864 22102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d5cfcf68d944a83aa2ddd94cc5bf761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:37.692078 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.687424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39198 (local address 127.11.70.193:34215)
0808 05:03:37.687619 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.687624 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.687993 (+ 369us) server_negotiation.cc:407] Connection header received
0808 05:03:37.688070 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.688073 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.688091 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.688180 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:37.688415 (+ 235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.689486 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.690692 (+ 1206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.691392 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.691457 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.691523 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.691949 (+ 426us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.691993 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":77,"threads_started":1}
I20260808 05:03:37.692530 22245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.687268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:37021 (local address 127.0.0.1:57668)
0808 05:03:37.688177 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.688188 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.688241 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.688508 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.688509 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.688511 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:37.688554 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.688555 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.689813 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.689814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.691240 (+ 1426us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.691243 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.692295 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.692296 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.692363 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.692367 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.692423 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.692463 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":894,"thread_start_us":74,"threads_started":1}
I20260808 05:03:37.692567 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.687530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57668 (local address 127.11.70.194:37021)
0808 05:03:37.688124 (+ 594us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.688128 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.688266 (+ 138us) server_negotiation.cc:407] Connection header received
0808 05:03:37.688319 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.688321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.688338 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.688435 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:37.688638 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.689734 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.691333 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.692096 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.692181 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.692258 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.692440 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.692478 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":80,"threads_started":1}
I20260808 05:03:37.692756 21698 tablet_service.cc:1467] Processing CreateTablet for tablet 1d5cfcf68d944a83aa2ddd94cc5bf761 (DEFAULT_TABLE table=test-table [id=9120549e70a14cd7bab7cc20d9a6957d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:37.693109 21698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d5cfcf68d944a83aa2ddd94cc5bf761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:37.693200 21900 tablet_service.cc:1467] Processing CreateTablet for tablet 1d5cfcf68d944a83aa2ddd94cc5bf761 (DEFAULT_TABLE table=test-table [id=9120549e70a14cd7bab7cc20d9a6957d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:37.693437 21900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1d5cfcf68d944a83aa2ddd94cc5bf761. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:37.695719 22252 tablet_bootstrap.cc:492] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: Bootstrap starting.
I20260808 05:03:37.696218 22253 tablet_bootstrap.cc:492] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: Bootstrap starting.
I20260808 05:03:37.696506 22252 tablet_bootstrap.cc:654] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:37.696825 22252 log.cc:824] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:37.696947 22253 tablet_bootstrap.cc:654] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:37.697293 22253 log.cc:824] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:37.697559 22255 tablet_bootstrap.cc:492] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: Bootstrap starting.
I20260808 05:03:37.697623 22252 tablet_bootstrap.cc:492] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: No bootstrap required, opened a new log
I20260808 05:03:37.697695 22252 ts_tablet_manager.cc:1397] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:37.698269 22255 tablet_bootstrap.cc:654] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:37.698648 22255 log.cc:824] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:37.699389 22255 tablet_bootstrap.cc:492] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: No bootstrap required, opened a new log
I20260808 05:03:37.699414 22253 tablet_bootstrap.cc:492] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: No bootstrap required, opened a new log
I20260808 05:03:37.699461 22255 ts_tablet_manager.cc:1397] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:03:37.699473 22253 ts_tablet_manager.cc:1397] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 05:03:37.699985 22252 raft_consensus.cc:348] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:37.700140 22252 raft_consensus.cc:374] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:37.700188 22252 raft_consensus.cc:729] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb940d57f34b4f92b9a47ba469e6fcb4, State: Initialized, Role: FOLLOWER
I20260808 05:03:37.700306 22252 consensus_queue.cc:260] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:37.700606 22252 ts_tablet_manager.cc:1428] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:03:37.700696 22208 heartbeater.cc:503] Master 127.11.70.254:39095 was elected leader, sending a full tablet report...
I20260808 05:03:37.701718 22255 raft_consensus.cc:348] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:37.701884 22255 raft_consensus.cc:374] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:37.701927 22255 raft_consensus.cc:729] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c208a29c7a214f9abe84ae90c0a836bf, State: Initialized, Role: FOLLOWER
I20260808 05:03:37.702037 22255 consensus_queue.cc:260] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:37.702307 22255 ts_tablet_manager.cc:1428] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:03:37.702577 21794 heartbeater.cc:503] Master 127.11.70.254:39095 was elected leader, sending a full tablet report...
I20260808 05:03:37.702780 22253 raft_consensus.cc:348] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:37.702950 22253 raft_consensus.cc:374] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:37.702998 22253 raft_consensus.cc:729] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 110aa8a723ee413abbe59cb435f2ac6c, State: Initialized, Role: FOLLOWER
I20260808 05:03:37.703117 22253 consensus_queue.cc:260] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:37.703387 22253 ts_tablet_manager.cc:1428] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260808 05:03:37.703472 21998 heartbeater.cc:503] Master 127.11.70.254:39095 was elected leader, sending a full tablet report...
W20260808 05:03:37.770051 22001 tablet.cc:2369] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:37.818929 22259 raft_consensus.cc:482] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:37.819062 22259 raft_consensus.cc:504] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:37.819520 22259 leader_election.cc:288] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 110aa8a723ee413abbe59cb435f2ac6c (127.11.70.194:37021), c208a29c7a214f9abe84ae90c0a836bf (127.11.70.193:34215)
I20260808 05:03:37.822412 22215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.819742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:37021 (local address 127.11.70.195:53337)
0808 05:03:37.819801 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.819814 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.819860 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.820023 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.820024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.820027 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:37.820123 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.820125 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.820834 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.820835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.821591 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.821592 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.822157 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.822158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.822238 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.822241 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.822289 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.822317 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 05:03:37.822471 22250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.819823 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:53337 (local address 127.11.70.194:37021)
0808 05:03:37.819886 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.819888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.819900 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:03:37.819929 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.819930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.819941 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.820005 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:37.820213 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.820724 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.821687 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.822070 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.822127 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.822134 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.822319 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.822370 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:03:37.822521 22249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.819856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:56677 (local address 127.11.70.193:34215)
0808 05:03:37.819924 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.819926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.819934 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:37.819970 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.819970 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.819999 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.820064 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:37.820262 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.820716 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.821710 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.822091 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.822185 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.822193 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.822382 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.822424 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 05:03:37.822549 22216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.819793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:34215 (local address 127.11.70.195:56677)
0808 05:03:37.819852 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:37.819862 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:37.819909 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:37.820092 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:37.820092 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:37.820094 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:37.820158 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.820160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.820803 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.820804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.821591 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:37.821593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.822209 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.822210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:37.822294 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.822298 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:37.822357 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:03:37.822391 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40,"mutex_wait_us":52}
I20260808 05:03:37.822805 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d5cfcf68d944a83aa2ddd94cc5bf761" candidate_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "110aa8a723ee413abbe59cb435f2ac6c" is_pre_election: true
I20260808 05:03:37.822870 21726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d5cfcf68d944a83aa2ddd94cc5bf761" candidate_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c208a29c7a214f9abe84ae90c0a836bf" is_pre_election: true
I20260808 05:03:37.822986 21726 raft_consensus.cc:2454] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb940d57f34b4f92b9a47ba469e6fcb4 in term 0.
I20260808 05:03:37.822969 21929 raft_consensus.cc:2454] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb940d57f34b4f92b9a47ba469e6fcb4 in term 0.
I20260808 05:03:37.823220 22035 leader_election.cc:302] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c208a29c7a214f9abe84ae90c0a836bf, eb940d57f34b4f92b9a47ba469e6fcb4; no voters:
I20260808 05:03:37.823372 22259 raft_consensus.cc:2781] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:37.823431 22259 raft_consensus.cc:482] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:37.823465 22259 raft_consensus.cc:3037] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:37.824361 22259 raft_consensus.cc:504] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:37.824536 22259 leader_election.cc:288] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [CANDIDATE]: Term 1 election: Requested vote from peers 110aa8a723ee413abbe59cb435f2ac6c (127.11.70.194:37021), c208a29c7a214f9abe84ae90c0a836bf (127.11.70.193:34215)
I20260808 05:03:37.824659 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d5cfcf68d944a83aa2ddd94cc5bf761" candidate_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "110aa8a723ee413abbe59cb435f2ac6c"
I20260808 05:03:37.824735 21726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1d5cfcf68d944a83aa2ddd94cc5bf761" candidate_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c208a29c7a214f9abe84ae90c0a836bf"
I20260808 05:03:37.824749 21929 raft_consensus.cc:3037] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:37.824818 21726 raft_consensus.cc:3037] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:37.825711 21929 raft_consensus.cc:2454] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb940d57f34b4f92b9a47ba469e6fcb4 in term 1.
I20260808 05:03:37.825820 21726 raft_consensus.cc:2454] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb940d57f34b4f92b9a47ba469e6fcb4 in term 1.
I20260808 05:03:37.825908 22036 leader_election.cc:302] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 110aa8a723ee413abbe59cb435f2ac6c, eb940d57f34b4f92b9a47ba469e6fcb4; no voters:
I20260808 05:03:37.826045 22259 raft_consensus.cc:2781] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:37.826238 22259 raft_consensus.cc:686] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 LEADER]: Becoming Leader. State: Replica: eb940d57f34b4f92b9a47ba469e6fcb4, State: Running, Role: LEADER
I20260808 05:03:37.826346 22259 consensus_queue.cc:237] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:37.827466 20388 catalog_manager.cc:5495] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb940d57f34b4f92b9a47ba469e6fcb4 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } health_report { overall_health: UNKNOWN } } }
I20260808 05:03:37.835570 22247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.833283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38006 (local address 127.11.70.195:39115)
0808 05:03:37.833356 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.833358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.833367 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:37.833405 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.833406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.833421 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.833538 (+ 117us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:37.833673 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.834109 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.834889 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.835073 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.835131 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.835280 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:37.835376 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:37.835436 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.835469 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.835486 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:03:37.837350 21726 raft_consensus.cc:1261] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [term 1 FOLLOWER]: Refusing update from remote peer eb940d57f34b4f92b9a47ba469e6fcb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:37.837350 21929 raft_consensus.cc:1261] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [term 1 FOLLOWER]: Refusing update from remote peer eb940d57f34b4f92b9a47ba469e6fcb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:37.837738 22262 consensus_queue.cc:1035] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:37.837858 22259 consensus_queue.cc:1035] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:37.842166 22269 mvcc.cc:205] Tried to move back new op lower bound from 7316133551459147776 to 7316133551417442304. Current Snapshot: MvccSnapshot[applied={T|T < 7316133551459147776}]
I20260808 05:03:37.842339 22270 mvcc.cc:205] Tried to move back new op lower bound from 7316133551459147776 to 7316133551417442304. Current Snapshot: MvccSnapshot[applied={T|T < 7316133551459147776}]
I20260808 05:03:37.843462 20387 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:37.843569 20387 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50510:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:37.844851 20387 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ebdad661391434fa59236ad37e2fb05: Sending DeleteTablet for 3 replicas of tablet 1d5cfcf68d944a83aa2ddd94cc5bf761
I20260808 05:03:37.845196 21698 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d5cfcf68d944a83aa2ddd94cc5bf761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:37 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:39198
I20260808 05:03:37.845224 22102 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d5cfcf68d944a83aa2ddd94cc5bf761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:37 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:37998
I20260808 05:03:37.845422 22284 tablet_replica.cc:330] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: stopping tablet replica
I20260808 05:03:37.845518 22284 raft_consensus.cc:2229] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:37.845616 22284 raft_consensus.cc:2258] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:37.845891 21900 tablet_service.cc:1514] Processing DeleteTablet for tablet 1d5cfcf68d944a83aa2ddd94cc5bf761 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:37 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:57668
I20260808 05:03:37.846109 22287 tablet_replica.cc:330] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: stopping tablet replica
I20260808 05:03:37.846251 22287 raft_consensus.cc:2229] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:37.846386 22287 raft_consensus.cc:2258] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:37.846377 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 20343
I20260808 05:03:37.852662 22287 ts_tablet_manager.cc:1905] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:37.854611 22287 ts_tablet_manager.cc:1918] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:37.854730 22287 log.cc:1196] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/1d5cfcf68d944a83aa2ddd94cc5bf761
I20260808 05:03:37.855098 22287 ts_tablet_manager.cc:1939] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P 110aa8a723ee413abbe59cb435f2ac6c: Deleting consensus metadata
W20260808 05:03:37.858961 21830 connection.cc:535] server connection from 127.0.0.1:57668 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 05:03:37.859027 22284 ts_tablet_manager.cc:1905] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:37.861186 22284 ts_tablet_manager.cc:1918] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:37.861267 22284 log.cc:1196] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/1d5cfcf68d944a83aa2ddd94cc5bf761
I20260808 05:03:37.861673 22284 ts_tablet_manager.cc:1939] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P c208a29c7a214f9abe84ae90c0a836bf: Deleting consensus metadata
W20260808 05:03:37.862085 21630 connection.cc:441] server connection from 127.0.0.1:39198 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39198 (request call id 1) could send its response
I20260808 05:03:37.862442 22283 tablet_replica.cc:330] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: stopping tablet replica
I20260808 05:03:37.862794 22283 raft_consensus.cc:2229] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:37.862926 22283 raft_consensus.cc:2258] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:37.863438 22283 ts_tablet_manager.cc:1905] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:37.865311 22283 ts_tablet_manager.cc:1918] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:37.865423 22283 log.cc:1196] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/1d5cfcf68d944a83aa2ddd94cc5bf761
I20260808 05:03:37.865746 22283 ts_tablet_manager.cc:1939] T 1d5cfcf68d944a83aa2ddd94cc5bf761 P eb940d57f34b4f92b9a47ba469e6fcb4: Deleting consensus metadata
W20260808 05:03:37.866091 22030 connection.cc:441] server connection from 127.0.0.1:37998 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:37998 (request call id 1) could send its response
I20260808 05:03:37.871908 21323 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.861330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43420 (local address 127.11.70.253:40563)
0808 05:03:37.861382 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.861384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.861746 (+ 362us) server_negotiation.cc:407] Connection header received
0808 05:03:37.861860 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.861861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.861873 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.861906 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.862752 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.863555 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.866769 (+ 3214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.867056 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.867122 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.868575 (+ 1453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.868576 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.868577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.868584 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.870380 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.870975 (+ 595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.870977 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.870977 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.871040 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.871259 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.871260 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.871260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.871396 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.871486 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.871700 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.871785 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:03:37.872072 21806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.861519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34658 (local address 127.11.70.252:39183)
0808 05:03:37.861560 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.861562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.861872 (+ 310us) server_negotiation.cc:407] Connection header received
0808 05:03:37.861970 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.861971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.861981 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.862011 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.863353 (+ 1342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.864034 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.866054 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.866344 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.866382 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.868098 (+ 1716us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.868100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.868100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.868108 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.870640 (+ 2532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.871226 (+ 586us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.871228 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.871228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.871284 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.871487 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.871488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.871489 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.871614 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.871687 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.871914 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.871988 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:37.872387 22236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:37.845873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34652 (local address 127.11.70.252:39183)
0808 05:03:37.846076 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:37.846078 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:37.862336 (+ 16258us) server_negotiation.cc:407] Connection header received
0808 05:03:37.863653 (+ 1317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:37.863654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:37.863670 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:37.863721 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:37.864536 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.865288 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.866451 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:37.867161 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:37.867232 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:37.868892 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:37.868893 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:37.868894 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:37.868900 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:37.870900 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.871331 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.871332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.871332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.871390 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:37.871585 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:37.871586 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:37.871586 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:37.871705 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:37.871787 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:37.872093 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 05:03:37.872292 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178}
I20260808 05:03:38.842610 22305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:38.842242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.194:33083)
0808 05:03:38.842409 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:38.842547 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":72,"threads_started":1}
I20260808 05:03:38.842860 22298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:38.842239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.195:43487)
0808 05:03:38.842724 (+ 485us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:38.842814 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":72,"threads_started":1}
I20260808 05:03:38.842882 22304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:38.842253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.193:51375)
0808 05:03:38.842772 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:38.842840 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":76,"threads_started":1}
W20260808 05:03:38.843053 22208 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:39095 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
W20260808 05:03:38.843075 21794 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:39095 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
W20260808 05:03:38.843158 21998 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:39095 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
I20260808 05:03:39.345613 22306 raft_consensus.cc:482] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ebdad661391434fa59236ad37e2fb05)
I20260808 05:03:39.345855 22306 raft_consensus.cc:504] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } }
I20260808 05:03:39.346177 22306 leader_election.cc:288] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ebdad661391434fa59236ad37e2fb05 (127.11.70.254:39095), dfdcc0ad4ed9486da87c2cd6bb0de50f (127.11.70.253:40563)
I20260808 05:03:39.346684 22309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.346312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50908)
0808 05:03:39.346491 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.346622 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
W20260808 05:03:39.346868 21502 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
I20260808 05:03:39.347059 22315 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6ebdad661391434fa59236ad37e2fb05)
I20260808 05:03:39.347275 22315 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } }
I20260808 05:03:39.347360 22309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.347218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50914)
0808 05:03:39.347297 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.347334 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260808 05:03:39.347450 21502 leader_election.cc:334] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6ebdad661391434fa59236ad37e2fb05 (127.11.70.254:39095): Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
I20260808 05:03:39.348009 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.347789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50924)
0808 05:03:39.347905 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.347970 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":73,"threads_started":1}
I20260808 05:03:39.348037 22315 leader_election.cc:288] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6ebdad661391434fa59236ad37e2fb05 (127.11.70.254:39095), a51bf5cb8cd64e5e802ebe9b416c3bf2 (127.11.70.252:39183)
W20260808 05:03:39.348112 21232 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
I20260808 05:03:39.348567 22320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.348460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50940)
0808 05:03:39.348492 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.348537 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260808 05:03:39.348644 21232 leader_election.cc:334] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6ebdad661391434fa59236ad37e2fb05 (127.11.70.254:39095): Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
I20260808 05:03:39.350274 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.346390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:40563 (local address 127.0.0.1:43428)
0808 05:03:39.346547 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.346560 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:39.346635 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:39.346856 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:39.346857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:39.346860 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:39.346924 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.346926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.347914 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.347915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.349285 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.349287 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.350084 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.350085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.350135 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.350138 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:39.350182 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:03:39.350215 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260808 05:03:39.350330 22314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.346511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43428 (local address 127.11.70.253:40563)
0808 05:03:39.346653 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:39.346655 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:39.346689 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:03:39.346724 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:39.346725 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:39.346740 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:39.346818 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:39.347023 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.347772 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.349368 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.350000 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.350086 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.350099 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:39.350210 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 05:03:39.350259 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
I20260808 05:03:39.350535 21269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" is_pre_election: true
I20260808 05:03:39.350638 21269 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a51bf5cb8cd64e5e802ebe9b416c3bf2 in term 1.
I20260808 05:03:39.350785 21504 leader_election.cc:302] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a51bf5cb8cd64e5e802ebe9b416c3bf2, dfdcc0ad4ed9486da87c2cd6bb0de50f; no voters: 6ebdad661391434fa59236ad37e2fb05
I20260808 05:03:39.350889 22306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 05:03:39.350930 22306 raft_consensus.cc:482] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6ebdad661391434fa59236ad37e2fb05)
I20260808 05:03:39.350960 22306 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:03:39.351753 22321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.347815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:39183 (local address 127.0.0.1:34660)
0808 05:03:39.348315 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.348326 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:39.348389 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:39.348600 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:39.348601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:39.348604 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:39.348672 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.348674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.349585 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.349586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.350898 (+ 1312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.350901 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.351560 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.351561 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.351615 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.351619 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:39.351673 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:03:39.351705 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":489,"thread_start_us":50,"threads_started":1}
I20260808 05:03:39.351840 22324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.348047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34660 (local address 127.11.70.252:39183)
0808 05:03:39.348296 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:39.348299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:39.348378 (+ 79us) server_negotiation.cc:407] Connection header received
0808 05:03:39.348452 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:39.348453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:39.348465 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:39.348546 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:39.348770 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.349484 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.350970 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.351464 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.351541 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.351551 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:39.351697 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 05:03:39.351748 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":94,"threads_started":1}
I20260808 05:03:39.351941 22306 raft_consensus.cc:504] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } }
I20260808 05:03:39.352097 22306 leader_election.cc:288] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [CANDIDATE]: Term 2 election: Requested vote from peers 6ebdad661391434fa59236ad37e2fb05 (127.11.70.254:39095), dfdcc0ad4ed9486da87c2cd6bb0de50f (127.11.70.253:40563)
I20260808 05:03:39.352150 21539 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" is_pre_election: true
I20260808 05:03:39.352270 21539 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate dfdcc0ad4ed9486da87c2cd6bb0de50f in current term 2: Already voted for candidate a51bf5cb8cd64e5e802ebe9b416c3bf2 in this term.
I20260808 05:03:39.352285 21269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f"
I20260808 05:03:39.352348 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.352161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50950)
0808 05:03:39.352217 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.352261 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 05:03:39.352362 21269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:03:39.352499 21240 leader_election.cc:302] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: dfdcc0ad4ed9486da87c2cd6bb0de50f; no voters: 6ebdad661391434fa59236ad37e2fb05, a51bf5cb8cd64e5e802ebe9b416c3bf2
I20260808 05:03:39.352628 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.352539 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50958)
0808 05:03:39.352587 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.352607 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 05:03:39.352692 21502 leader_election.cc:334] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6ebdad661391434fa59236ad37e2fb05 (127.11.70.254:39095): Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
I20260808 05:03:39.353122 21269 raft_consensus.cc:2454] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a51bf5cb8cd64e5e802ebe9b416c3bf2 in term 2.
I20260808 05:03:39.353209 22315 raft_consensus.cc:2726] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:03:39.353338 21504 leader_election.cc:302] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a51bf5cb8cd64e5e802ebe9b416c3bf2, dfdcc0ad4ed9486da87c2cd6bb0de50f; no voters: 6ebdad661391434fa59236ad37e2fb05
I20260808 05:03:39.353464 22306 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:03:39.353686 22306 raft_consensus.cc:686] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [term 2 LEADER]: Becoming Leader. State: Replica: a51bf5cb8cd64e5e802ebe9b416c3bf2, State: Running, Role: LEADER
I20260808 05:03:39.353782 22306 consensus_queue.cc:237] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } }
I20260808 05:03:39.354151 22327 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a51bf5cb8cd64e5e802ebe9b416c3bf2. Latest consensus state: current_term: 2 leader_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:39.354249 22327 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:39.354442 22331 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:39.355057 22331 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:39.355165 22331 catalog_manager.cc:1259] Loaded cluster ID: 6fd2726a373d45cf8be486c4da27b8d2
I20260808 05:03:39.355202 22331 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:39.355410 22331 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:39.355513 22331 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Loaded TSK: 0
I20260808 05:03:39.355671 22331 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:03:39.404884 21526 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34658:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:39.406622 21526 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:39.407673 21269 raft_consensus.cc:1261] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [term 2 FOLLOWER]: Refusing update from remote peer a51bf5cb8cd64e5e802ebe9b416c3bf2: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 05:03:39.407714 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.407560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50980)
0808 05:03:39.407657 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.407685 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260808 05:03:39.407948 22327 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260808 05:03:39.408077 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.407971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.0.0.1:50992)
0808 05:03:39.408022 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.408051 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 05:03:39.408175 21502 consensus_peers.cc:487] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 -> Peer 6ebdad661391434fa59236ad37e2fb05 (127.11.70.254:39095): Couldn't send request to peer 6ebdad661391434fa59236ad37e2fb05. Status: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 05:03:39.408677 22315 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a51bf5cb8cd64e5e802ebe9b416c3bf2. Latest consensus state: current_term: 2 leader_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:39.408813 22315 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:03:39.409227 22327 sys_catalog.cc:455] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:39.409327 22327 sys_catalog.cc:458] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:39.409421 22333 mvcc.cc:205] Tried to move back new op lower bound from 7316133557891837952 to 7316133557673746432. Current Snapshot: MvccSnapshot[applied={T|T < 7316133557891837952}]
I20260808 05:03:39.409578 22315 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "6ebdad661391434fa59236ad37e2fb05" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39095 } } peers { permanent_uuid: "dfdcc0ad4ed9486da87c2cd6bb0de50f" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 40563 } attrs { promote: false } } peers { permanent_uuid: "a51bf5cb8cd64e5e802ebe9b416c3bf2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 39183 } attrs { promote: false } } }
I20260808 05:03:39.409673 22315 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfdcc0ad4ed9486da87c2cd6bb0de50f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:03:39.414774 22309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.411034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:37021 (local address 127.0.0.1:57678)
0808 05:03:39.411091 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.411102 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:39.411149 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:39.411516 (+ 367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:39.411517 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:39.411520 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:39.411583 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.411585 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.412554 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.412555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.413762 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.413763 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.414499 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.414500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.414563 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.414567 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:39.414657 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:03:39.414703 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":46}
I20260808 05:03:39.414776 22340 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.411131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57678 (local address 127.11.70.194:37021)
0808 05:03:39.411292 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:39.411294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:39.411302 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:39.411334 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:39.411335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:39.411363 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:39.411633 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:39.411664 (+ 31us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.412468 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.413900 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.414395 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.414502 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.414517 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:39.414665 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 05:03:39.414709 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":90,"threads_started":1}
I20260808 05:03:39.414853 22338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.411143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39208 (local address 127.11.70.193:34215)
0808 05:03:39.411282 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:39.411284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:39.411436 (+ 152us) server_negotiation.cc:407] Connection header received
0808 05:03:39.411514 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:39.411515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:39.411527 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:39.411593 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:39.411741 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.412463 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.413850 (+ 1387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.414430 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.414531 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.414546 (+ 15us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:39.414718 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 05:03:39.414776 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":49,"threads_started":1}
I20260808 05:03:39.415040 22311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.411052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:34215 (local address 127.0.0.1:39208)
0808 05:03:39.411385 (+ 333us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.411397 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:39.411449 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:39.411600 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:39.411601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:39.411602 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:39.411643 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.411645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.412554 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.412555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.413753 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.413756 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.414578 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.414579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.414633 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.414637 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:39.414935 (+ 298us) client_negotiation.cc:240] Negotiation successful
0808 05:03:39.414977 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":318,"mutex_wait_us":32}
I20260808 05:03:39.415318 21698 tablet_service.cc:1467] Processing CreateTablet for tablet 03ed6c59cbc247459ecb1b518f3a7ba1 (DEFAULT_TABLE table=test-table [id=2caa572a79844556827d54b23eb9d253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:39.415422 21900 tablet_service.cc:1467] Processing CreateTablet for tablet 03ed6c59cbc247459ecb1b518f3a7ba1 (DEFAULT_TABLE table=test-table [id=2caa572a79844556827d54b23eb9d253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:39.415473 21698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ed6c59cbc247459ecb1b518f3a7ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:39.415526 21900 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ed6c59cbc247459ecb1b518f3a7ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:39.415670 22342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.411127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:39115 (local address 127.0.0.1:38022)
0808 05:03:39.412596 (+ 1469us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.412606 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:39.412689 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:39.412829 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:39.412829 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:39.412831 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:39.412872 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.412873 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.413476 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.413477 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.414522 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:39.414525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.415404 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.415405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:39.415468 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.415471 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:39.415555 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:03:39.415595 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1444,"thread_start_us":100,"threads_started":1}
I20260808 05:03:39.415678 22344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.411290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38022 (local address 127.11.70.195:39115)
0808 05:03:39.411392 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:39.411395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:39.412679 (+ 1284us) server_negotiation.cc:407] Connection header received
0808 05:03:39.412752 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:39.412752 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:39.412763 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:39.412827 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:39.412922 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.413392 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.414615 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.415320 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.415403 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.415415 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:39.415563 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 05:03:39.415609 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":58,"threads_started":1}
I20260808 05:03:39.417026 22345 tablet_bootstrap.cc:492] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: Bootstrap starting.
I20260808 05:03:39.417376 22102 tablet_service.cc:1467] Processing CreateTablet for tablet 03ed6c59cbc247459ecb1b518f3a7ba1 (DEFAULT_TABLE table=test-table [id=2caa572a79844556827d54b23eb9d253]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:39.417528 22345 tablet_bootstrap.cc:654] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:39.417546 22102 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 03ed6c59cbc247459ecb1b518f3a7ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:39.417836 22346 tablet_bootstrap.cc:492] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf: Bootstrap starting.
I20260808 05:03:39.418172 22345 tablet_bootstrap.cc:492] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: No bootstrap required, opened a new log
I20260808 05:03:39.418292 22345 ts_tablet_manager.cc:1397] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:39.418337 22346 tablet_bootstrap.cc:654] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:39.418524 22345 raft_consensus.cc:348] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:39.418643 22345 raft_consensus.cc:374] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:39.418701 22345 raft_consensus.cc:729] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 110aa8a723ee413abbe59cb435f2ac6c, State: Initialized, Role: FOLLOWER
I20260808 05:03:39.418776 22345 consensus_queue.cc:260] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:39.418944 22345 ts_tablet_manager.cc:1428] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:39.419404 22350 tablet_bootstrap.cc:492] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: Bootstrap starting.
I20260808 05:03:39.419515 22346 tablet_bootstrap.cc:492] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf: No bootstrap required, opened a new log
I20260808 05:03:39.419564 22346 ts_tablet_manager.cc:1397] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:03:39.419651 22352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.419217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.194:36317)
0808 05:03:39.419565 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.419608 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":324,"thread_start_us":76,"threads_started":1}
I20260808 05:03:39.419698 22346 raft_consensus.cc:348] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:39.419783 22346 raft_consensus.cc:374] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:39.419808 22346 raft_consensus.cc:729] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c208a29c7a214f9abe84ae90c0a836bf, State: Initialized, Role: FOLLOWER
I20260808 05:03:39.419822 22350 tablet_bootstrap.cc:654] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:39.419852 22346 consensus_queue.cc:260] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:39.420051 22346 ts_tablet_manager.cc:1428] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:39.420643 21995 heartbeater.cc:503] Master 127.11.70.252:39183 was elected leader, sending a full tablet report...
I20260808 05:03:39.420655 21793 heartbeater.cc:503] Master 127.11.70.252:39183 was elected leader, sending a full tablet report...
I20260808 05:03:39.420799 22352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.420697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.194:55889)
0808 05:03:39.420743 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.420769 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 05:03:39.420857 22350 tablet_bootstrap.cc:492] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: No bootstrap required, opened a new log
I20260808 05:03:39.420903 22350 ts_tablet_manager.cc:1397] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:39.421007 22350 raft_consensus.cc:348] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:39.421077 22350 raft_consensus.cc:374] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:39.421096 22350 raft_consensus.cc:729] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb940d57f34b4f92b9a47ba469e6fcb4, State: Initialized, Role: FOLLOWER
I20260808 05:03:39.421136 22350 consensus_queue.cc:260] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:39.421296 22350 ts_tablet_manager.cc:1428] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:39.421659 22360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.421439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.195:39053)
0808 05:03:39.421571 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.421618 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":83,"threads_started":1}
I20260808 05:03:39.421717 22354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.420238 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.193:38163)
0808 05:03:39.421633 (+ 1395us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.421673 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1373,"thread_start_us":82,"threads_started":1}
I20260808 05:03:39.422029 22360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.421930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.195:41151)
0808 05:03:39.421969 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.422003 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260808 05:03:39.422168 22354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.421930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.193:37073)
0808 05:03:39.422118 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.422146 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":171}
I20260808 05:03:39.553294 22356 raft_consensus.cc:482] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:39.553417 22356 raft_consensus.cc:504] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:39.553658 22356 leader_election.cc:288] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 110aa8a723ee413abbe59cb435f2ac6c (127.11.70.194:37021), c208a29c7a214f9abe84ae90c0a836bf (127.11.70.193:34215)
I20260808 05:03:39.553977 21726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ed6c59cbc247459ecb1b518f3a7ba1" candidate_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c208a29c7a214f9abe84ae90c0a836bf" is_pre_election: true
I20260808 05:03:39.553956 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ed6c59cbc247459ecb1b518f3a7ba1" candidate_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "110aa8a723ee413abbe59cb435f2ac6c" is_pre_election: true
I20260808 05:03:39.554075 21929 raft_consensus.cc:2454] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb940d57f34b4f92b9a47ba469e6fcb4 in term 0.
I20260808 05:03:39.554075 21726 raft_consensus.cc:2454] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb940d57f34b4f92b9a47ba469e6fcb4 in term 0.
I20260808 05:03:39.554268 22036 leader_election.cc:302] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 110aa8a723ee413abbe59cb435f2ac6c, c208a29c7a214f9abe84ae90c0a836bf, eb940d57f34b4f92b9a47ba469e6fcb4; no voters:
I20260808 05:03:39.554400 22356 raft_consensus.cc:2781] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:39.554450 22356 raft_consensus.cc:482] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:39.554488 22356 raft_consensus.cc:3037] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:39.555438 22356 raft_consensus.cc:504] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:39.555642 22356 leader_election.cc:288] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [CANDIDATE]: Term 1 election: Requested vote from peers 110aa8a723ee413abbe59cb435f2ac6c (127.11.70.194:37021), c208a29c7a214f9abe84ae90c0a836bf (127.11.70.193:34215)
I20260808 05:03:39.555738 21726 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ed6c59cbc247459ecb1b518f3a7ba1" candidate_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c208a29c7a214f9abe84ae90c0a836bf"
I20260808 05:03:39.555738 21929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "03ed6c59cbc247459ecb1b518f3a7ba1" candidate_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "110aa8a723ee413abbe59cb435f2ac6c"
I20260808 05:03:39.555821 21929 raft_consensus.cc:3037] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:39.555821 21726 raft_consensus.cc:3037] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:39.556602 21929 raft_consensus.cc:2454] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb940d57f34b4f92b9a47ba469e6fcb4 in term 1.
I20260808 05:03:39.556602 21726 raft_consensus.cc:2454] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb940d57f34b4f92b9a47ba469e6fcb4 in term 1.
I20260808 05:03:39.556792 22036 leader_election.cc:302] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 110aa8a723ee413abbe59cb435f2ac6c, eb940d57f34b4f92b9a47ba469e6fcb4; no voters:
I20260808 05:03:39.556897 22356 raft_consensus.cc:2781] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:39.557082 22356 raft_consensus.cc:686] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 LEADER]: Becoming Leader. State: Replica: eb940d57f34b4f92b9a47ba469e6fcb4, State: Running, Role: LEADER
I20260808 05:03:39.557152 22356 consensus_queue.cc:237] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } }
I20260808 05:03:39.557194 22207 heartbeater.cc:503] Master 127.11.70.252:39183 was elected leader, sending a full tablet report...
I20260808 05:03:39.557456 22360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.557328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.195:52265)
0808 05:03:39.557389 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.557429 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 05:03:39.557976 21526 catalog_manager.cc:5495] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb940d57f34b4f92b9a47ba469e6fcb4 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb940d57f34b4f92b9a47ba469e6fcb4" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 } health_report { overall_health: UNKNOWN } } }
I20260808 05:03:39.596711 22344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.594376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38034 (local address 127.11.70.195:39115)
0808 05:03:39.594424 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:39.594426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:39.594433 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:39.594547 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:39.594548 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:39.594558 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:39.594609 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:39.594717 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.595214 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.595977 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:39.596177 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:39.596234 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:39.596357 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:39.596402 (+ 45us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:39.596456 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:39.596501 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 05:03:39.596521 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:03:39.597836 21929 raft_consensus.cc:1261] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [term 1 FOLLOWER]: Refusing update from remote peer eb940d57f34b4f92b9a47ba469e6fcb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:39.597872 21726 raft_consensus.cc:1261] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [term 1 FOLLOWER]: Refusing update from remote peer eb940d57f34b4f92b9a47ba469e6fcb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:39.598115 22361 consensus_queue.cc:1035] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c208a29c7a214f9abe84ae90c0a836bf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34215 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:39.598238 22356 consensus_queue.cc:1035] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "110aa8a723ee413abbe59cb435f2ac6c" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 37021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:39.599021 22354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.598889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.193:39841)
0808 05:03:39.598939 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.598988 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:03:39.599426 22352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.599310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.194:33693)
0808 05:03:39.599359 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.599389 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 05:03:39.600253 22373 mvcc.cc:205] Tried to move back new op lower bound from 7316133558670635008 to 7316133558507290624. Current Snapshot: MvccSnapshot[applied={T|T < 7316133558670635008}]
I20260808 05:03:39.600598 22360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.600402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.195:60175)
0808 05:03:39.600487 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.600515 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
I20260808 05:03:39.600636 22352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.600555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.194:60385)
0808 05:03:39.600589 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.600610 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 05:03:39.601049 22354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.600934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.193:54223)
0808 05:03:39.600987 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.601014 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 05:03:39.601248 22360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.601163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39095 (local address 127.11.70.195:55687)
0808 05:03:39.601196 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.601216 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:39095: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 05:03:39.602689 21523 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:39.602780 21523 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34658:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:39.604142 21523 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a51bf5cb8cd64e5e802ebe9b416c3bf2: Sending DeleteTablet for 3 replicas of tablet 03ed6c59cbc247459ecb1b518f3a7ba1
I20260808 05:03:39.604441 21698 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ed6c59cbc247459ecb1b518f3a7ba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:39 UTC) from {username='oryx', principal='oryx/127.11.70.252@KRBTEST.COM'} at 127.0.0.1:39208
I20260808 05:03:39.604481 21900 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ed6c59cbc247459ecb1b518f3a7ba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:39 UTC) from {username='oryx', principal='oryx/127.11.70.252@KRBTEST.COM'} at 127.0.0.1:57678
I20260808 05:03:39.604521 22102 tablet_service.cc:1514] Processing DeleteTablet for tablet 03ed6c59cbc247459ecb1b518f3a7ba1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:39 UTC) from {username='oryx', principal='oryx/127.11.70.252@KRBTEST.COM'} at 127.0.0.1:38022
I20260808 05:03:39.604679 22386 tablet_replica.cc:330] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf: stopping tablet replica
I20260808 05:03:39.604703 22388 tablet_replica.cc:330] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: stopping tablet replica
I20260808 05:03:39.604744 22386 raft_consensus.cc:2229] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:39.604754 22388 raft_consensus.cc:2229] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:39.604795 22386 raft_consensus.cc:2258] T 03ed6c59cbc247459ecb1b518f3a7ba1 P c208a29c7a214f9abe84ae90c0a836bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:39.604799 22388 raft_consensus.cc:2258] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:39.604918 22389 tablet_replica.cc:330] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: stopping tablet replica
I20260808 05:03:39.604974 22389 raft_consensus.cc:2229] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:39.605024 22389 raft_consensus.cc:2258] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:39.605038 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 21458
I20260808 05:03:39.605283 22389 ts_tablet_manager.cc:1905] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:39.607442 22389 ts_tablet_manager.cc:1918] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:39.607501 22389 log.cc:1196] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/03ed6c59cbc247459ecb1b518f3a7ba1
I20260808 05:03:39.607800 22389 ts_tablet_manager.cc:1939] T 03ed6c59cbc247459ecb1b518f3a7ba1 P eb940d57f34b4f92b9a47ba469e6fcb4: Deleting consensus metadata
I20260808 05:03:39.608969 21506 catalog_manager.cc:4841] TS eb940d57f34b4f92b9a47ba469e6fcb4 (127.11.70.195:39115): tablet 03ed6c59cbc247459ecb1b518f3a7ba1 (table test-table [id=2caa572a79844556827d54b23eb9d253]) successfully deleted
I20260808 05:03:39.611435 22388 ts_tablet_manager.cc:1905] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:39.612875 22388 ts_tablet_manager.cc:1918] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:39.612954 22388 log.cc:1196] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/03ed6c59cbc247459ecb1b518f3a7ba1
I20260808 05:03:39.613216 22388 ts_tablet_manager.cc:1939] T 03ed6c59cbc247459ecb1b518f3a7ba1 P 110aa8a723ee413abbe59cb435f2ac6c: Deleting consensus metadata
I20260808 05:03:39.613559 21506 catalog_manager.cc:4841] TS 110aa8a723ee413abbe59cb435f2ac6c (127.11.70.194:37021): tablet 03ed6c59cbc247459ecb1b518f3a7ba1 (table test-table [id=2caa572a79844556827d54b23eb9d253]) successfully deleted
I20260808 05:03:39.621269 22342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:39.621133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:34215 (local address 127.0.0.1:39212)
0808 05:03:39.621192 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:39.621230 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:34215: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 05:03:39.621304 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 21808
W20260808 05:03:39.621455 21505 catalog_manager.cc:4584] TS c208a29c7a214f9abe84ae90c0a836bf (127.11.70.193:34215): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 03ed6c59cbc247459ecb1b518f3a7ba1: Network error: Client connection negotiation failed: client connection to 127.11.70.193:34215: connect: Connection refused (error 111)
I20260808 05:03:39.630973 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 22008
I20260808 05:03:39.641610 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 21061
I20260808 05:03:39.650345 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 21329
2026-08-08T05:03:39Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5856 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:39 dist-test-slave-7kzw krb5kdc[22394](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:39 dist-test-slave-7kzw krb5kdc[22394](info): set up 2 sockets
Aug 08 05:03:39 dist-test-slave-7kzw krb5kdc[22394](info): commencing operation
krb5kdc: starting...
W20260808 05:03:40.913641 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:40 dist-test-slave-7kzw krb5kdc[22394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:41Z Disabled control of system clock
WARNING: no policy specified for oryx/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.254.keytab.
Entry for principal oryx/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.254.keytab.
I20260808 05:03:41.041790 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:38027
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.254.keytab
--principal=oryx/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:38027
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:41.128420 22413 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:41.128661 22413 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:41.128702 22413 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:41.129863 22413 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:41.129932 22413 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 05:03:41.129957 22413 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:41.129990 22413 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:41.130018 22413 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:41.130043 22413 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:41.131669 22413 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:38027
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.254.keytab
--principal=oryx/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:38027
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22413
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:41.131960 22413 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:41.132206 22413 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:41.137544 22424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:41.137580 22430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:41.137581 22425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:41.137882 22413 server_base.cc:1034] running on GCE node
I20260808 05:03:41.138101 22413 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:41.138418 22413 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:41.139724 22413 hybrid_clock.cc:648] HybridClock initialized: now 1786165421139709 us; error 30 us; skew 500 ppm
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:41.142367 22413 init.cc:377] Logged in from keytab as oryx/127.11.70.254@KRBTEST.COM (short username oryx)
I20260808 05:03:41.142896 22413 webserver.cc:460] Webserver started at http://127.11.70.254:33655/ using document root <none> and password file <none>
I20260808 05:03:41.143154 22413 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:41.143203 22413 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:41.143375 22413 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:41.144449 22413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "d1e9907c3c4a49cba498c6f834569e2d"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "ffe4453a51aabc2dc8dce4a7d9dfa057"
server_key_iv: "7eb1fca09019fe84d2d54d4ff09740cb"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.144826 22413 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "d1e9907c3c4a49cba498c6f834569e2d"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "ffe4453a51aabc2dc8dce4a7d9dfa057"
server_key_iv: "7eb1fca09019fe84d2d54d4ff09740cb"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.146194 22413 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:41.147068 22437 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.147279 22413 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:41.147357 22413 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "d1e9907c3c4a49cba498c6f834569e2d"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "ffe4453a51aabc2dc8dce4a7d9dfa057"
server_key_iv: "7eb1fca09019fe84d2d54d4ff09740cb"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.147451 22413 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:41.167799 22413 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:41.169834 22413 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:41.170006 22413 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:41.175351 22413 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:38027
I20260808 05:03:41.175432 22529 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:38027 every 8 connection(s)
I20260808 05:03:41.175812 22413 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:41.176533 22530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:41.177044 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 22413
I20260808 05:03:41.177203 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:41.177500 11547 external_mini_cluster.cc:1428] Setting key d5ce6f107b809607e2f6ce8df3f58a7d
I20260808 05:03:41.179560 22530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: Bootstrap starting.
I20260808 05:03:41.180202 22530 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:41.180508 22530 log.cc:824] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:41.181205 22530 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: No bootstrap required, opened a new log
I20260808 05:03:41.183110 22530 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1e9907c3c4a49cba498c6f834569e2d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38027 } }
I20260808 05:03:41.183274 22530 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:41.183342 22530 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1e9907c3c4a49cba498c6f834569e2d, State: Initialized, Role: FOLLOWER
I20260808 05:03:41.183495 22530 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1e9907c3c4a49cba498c6f834569e2d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38027 } }
I20260808 05:03:41.183579 22530 raft_consensus.cc:388] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:41.183625 22530 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:41.183673 22530 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:41.184193 22530 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1e9907c3c4a49cba498c6f834569e2d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38027 } }
I20260808 05:03:41.184334 22530 leader_election.cc:302] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1e9907c3c4a49cba498c6f834569e2d; no voters:
I20260808 05:03:41.184501 22530 leader_election.cc:288] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:41.184567 22538 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:41.184746 22538 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [term 1 LEADER]: Becoming Leader. State: Replica: d1e9907c3c4a49cba498c6f834569e2d, State: Running, Role: LEADER
I20260808 05:03:41.184767 22530 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:41.184882 22538 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1e9907c3c4a49cba498c6f834569e2d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38027 } }
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:41.185230 22538 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1e9907c3c4a49cba498c6f834569e2d. Latest consensus state: current_term: 1 leader_uuid: "d1e9907c3c4a49cba498c6f834569e2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1e9907c3c4a49cba498c6f834569e2d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38027 } } }
I20260808 05:03:41.185330 22538 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:41.185241 22540 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1e9907c3c4a49cba498c6f834569e2d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1e9907c3c4a49cba498c6f834569e2d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38027 } } }
I20260808 05:03:41.185491 22540 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d [sys.catalog]: This master's current role is: LEADER
W20260808 05:03:41.186681 22558 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:03:41.186980 22558 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:03:41.187076 22546 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:41.187203 22546 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:41.188572 22546 catalog_manager.cc:1347] Generated new cluster ID: 5dd34efe52444e05bab612324a8f8c2a
I20260808 05:03:41.188627 22546 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:41.189869 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.178095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54512 (local address 127.11.70.254:38027)
0808 05:03:41.178296 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.178306 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.178344 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:03:41.178883 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.178891 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.178944 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.179105 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:41.179880 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.181018 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.181933 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.182405 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.182567 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.185572 (+ 3005us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:41.185576 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:41.185577 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:41.185592 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:41.188024 (+ 2432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.188532 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.188535 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.188536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.188662 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.188902 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.188903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.188904 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.189200 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:41.189344 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.189542 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.189676 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":88,"threads_started":1}
I20260808 05:03:41.207218 22546 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:41.208114 22546 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:41.216566 22546 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: Generated new TSK 0
I20260808 05:03:41.216785 22546 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab.
Entry for principal oryx/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab.
I20260808 05:03:41.253084 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38027
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab
--principal=oryx/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:41.336764 22567 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:41.336999 22567 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:41.337044 22567 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:41.338212 22567 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:41.338289 22567 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:41.338327 22567 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:03:41.338385 22567 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:41.339964 22567 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab
--principal=oryx/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.70.254:38027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22567
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:41.340234 22567 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:41.340478 22567 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:41.345715 22578 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:41.345728 22576 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:41.345820 22567 server_base.cc:1034] running on GCE node
W20260808 05:03:41.345758 22575 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:41.346143 22567 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:41.346410 22567 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:41.347574 22567 hybrid_clock.cc:648] HybridClock initialized: now 1786165421347550 us; error 42 us; skew 500 ppm
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:41.350428 22567 init.cc:377] Logged in from keytab as oryx/127.11.70.193@KRBTEST.COM (short username oryx)
I20260808 05:03:41.350914 22567 webserver.cc:460] Webserver started at http://127.11.70.193:33189/ using document root <none> and password file <none>
I20260808 05:03:41.351174 22567 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:41.351229 22567 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:41.351382 22567 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:41.352402 22567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "0ad7b154c342430b8828e066577b7757"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "ebaab0abcb2111134d79dfab329b3346"
server_key_iv: "7886e375a8b91ff98175aecbb7ea6ee5"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.352768 22567 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "0ad7b154c342430b8828e066577b7757"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "ebaab0abcb2111134d79dfab329b3346"
server_key_iv: "7886e375a8b91ff98175aecbb7ea6ee5"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.354076 22567 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:03:41.354882 22590 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.355053 22567 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.355142 22567 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "0ad7b154c342430b8828e066577b7757"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "ebaab0abcb2111134d79dfab329b3346"
server_key_iv: "7886e375a8b91ff98175aecbb7ea6ee5"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.355204 22567 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:41.362910 22567 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:41.365082 22567 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:41.365196 22567 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:41.365621 22567 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:41.365665 22567 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.365689 22567 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:41.365703 22567 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.372509 22567 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:44567
I20260808 05:03:41.372591 22763 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:44567 every 8 connection(s)
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:41.372975 22567 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:41.375849 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.366119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:49001 (local address 127.11.70.254:38027)
0808 05:03:41.366195 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.366198 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.366356 (+ 158us) server_negotiation.cc:407] Connection header received
0808 05:03:41.366870 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.366872 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.366885 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.366969 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:41.367795 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.368637 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.370218 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.370597 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.370697 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.373366 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:41.373367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:41.373367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:41.373375 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:41.374701 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.375073 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.375074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.375074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.375128 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.375342 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.375343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.375343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.375445 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:41.375497 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.375705 (+ 208us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.375785 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:03:41.375993 22606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.366046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38027 (local address 127.11.70.193:49001)
0808 05:03:41.366215 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.366270 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.366775 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.367016 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.367041 (+ 25us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.367409 (+ 368us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:41.367683 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.367688 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.368765 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.368766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.370134 (+ 1368us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.370137 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.370707 (+ 570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.370708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.370843 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.371365 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:41.371376 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:41.373209 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:41.374779 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.374786 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.374787 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.375003 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.375188 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.375189 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.375189 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.375287 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.375500 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:41.375504 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:41.375610 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.375694 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.375809 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":85,"threads_started":1}
I20260808 05:03:41.376490 22764 heartbeater.cc:347] Connected to a master server at 127.11.70.254:38027
I20260808 05:03:41.376592 22764 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:41.376796 22764 heartbeater.cc:511] Master 127.11.70.254:38027 requested a full tablet report, sending...
I20260808 05:03:41.377388 22463 ts_manager.cc:194] Registered new tserver with Master: 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567)
I20260808 05:03:41.378134 22463 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:49001
I20260808 05:03:41.379029 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 22567
I20260808 05:03:41.379163 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:41.379364 11547 external_mini_cluster.cc:1428] Setting key c1809a81e10b3b396753f58118b1196c
I20260808 05:03:41.383528 22772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.377561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38027 (local address 127.11.70.193:39369)
0808 05:03:41.377693 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.377703 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.377761 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.377960 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.377961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.378133 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:41.378183 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.378184 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.379130 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.379131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.379806 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.379808 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.380177 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.380178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.380253 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.380656 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:41.380660 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:41.380923 (+ 263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:41.382627 (+ 1704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.382628 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.382628 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.382794 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.383000 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.383001 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.383001 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.383051 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.383322 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:41.383322 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:41.383353 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.383399 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.383466 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":85,"threads_started":1}
I20260808 05:03:41.383628 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.377554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:39369 (local address 127.11.70.254:38027)
0808 05:03:41.377600 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.377602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.377854 (+ 252us) server_negotiation.cc:407] Connection header received
0808 05:03:41.377875 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.377876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.377885 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.377938 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:41.378271 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.379050 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.379888 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.380092 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.380173 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.381012 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:41.381014 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:41.381014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:41.381021 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:41.382552 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.382869 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.382870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.382870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.382935 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.383111 (+ 176us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.383112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.383112 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.383258 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:41.383335 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.383427 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.383504 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
WARNING: no policy specified for oryx/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab.
Entry for principal oryx/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab.
I20260808 05:03:41.405277 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38027
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab
--principal=oryx/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:41.487035 22775 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:41.487238 22775 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:41.487286 22775 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:41.488451 22775 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:41.488494 22775 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:41.488515 22775 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:03:41.488572 22775 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:41.490085 22775 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab
--principal=oryx/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.70.254:38027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22775
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:41.490339 22775 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:41.490584 22775 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:41.495597 22784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:41.495702 22782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:41.495596 22786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:41.495803 22775 server_base.cc:1034] running on GCE node
I20260808 05:03:41.496116 22775 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:41.496326 22775 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:41.497465 22775 hybrid_clock.cc:648] HybridClock initialized: now 1786165421497452 us; error 30 us; skew 500 ppm
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:41.499904 22775 init.cc:377] Logged in from keytab as oryx/127.11.70.194@KRBTEST.COM (short username oryx)
I20260808 05:03:41.500388 22775 webserver.cc:460] Webserver started at http://127.11.70.194:40421/ using document root <none> and password file <none>
I20260808 05:03:41.500629 22775 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:41.500701 22775 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:41.500859 22775 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:41.501873 22775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "e3707e6b13c047a59c1d8d97cc7528bf"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "48a7fe2d45bce0a2e8c80a074d89e237"
server_key_iv: "75dd6a87501123b8aa30f7c5b6f50b03"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.502243 22775 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "e3707e6b13c047a59c1d8d97cc7528bf"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "48a7fe2d45bce0a2e8c80a074d89e237"
server_key_iv: "75dd6a87501123b8aa30f7c5b6f50b03"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.503759 22775 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:41.504603 22798 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.504820 22775 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:41.504935 22775 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "e3707e6b13c047a59c1d8d97cc7528bf"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "48a7fe2d45bce0a2e8c80a074d89e237"
server_key_iv: "75dd6a87501123b8aa30f7c5b6f50b03"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.505012 22775 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:41.518535 22775 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:41.520550 22775 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:41.520723 22775 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:41.521377 22775 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:41.521430 22775 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.521469 22775 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:41.521484 22775 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:41.529259 22775 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:43521
I20260808 05:03:41.529389 22986 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:43521 every 8 connection(s)
I20260808 05:03:41.529701 22775 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:41.530364 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 22775
I20260808 05:03:41.530517 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:41.530812 11547 external_mini_cluster.cc:1428] Setting key 628dd4076f96ca88c2e2202d67a3c81d
I20260808 05:03:41.532239 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.521851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:49087 (local address 127.11.70.254:38027)
0808 05:03:41.521928 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.521931 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.522116 (+ 185us) server_negotiation.cc:407] Connection header received
0808 05:03:41.522645 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.522647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.522662 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.522752 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:41.523547 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.524072 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.525144 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.525373 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.525448 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.528939 (+ 3491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:41.528941 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:41.528941 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:41.528948 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:41.530685 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.531213 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.531215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.531215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.531285 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.531574 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.531575 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.531576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.531713 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:41.531772 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.532100 (+ 328us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.532163 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:03:41.532539 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.521772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38027 (local address 127.11.70.194:49087)
0808 05:03:41.521973 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.522013 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.522544 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.522963 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.522967 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.523233 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:41.523430 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.523434 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.524184 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.524185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.525041 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.525044 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.525471 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.525472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.525656 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.526211 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:41.526223 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:41.528833 (+ 2610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:41.530784 (+ 1951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.530793 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.530795 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.531132 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.531349 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.531349 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.531349 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.531501 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.531786 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:41.531794 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:41.531961 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.532078 (+ 117us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.532260 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":93,"threads_started":1}
I20260808 05:03:41.533918 22988 heartbeater.cc:347] Connected to a master server at 127.11.70.254:38027
I20260808 05:03:41.534008 22988 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:41.534204 22988 heartbeater.cc:511] Master 127.11.70.254:38027 requested a full tablet report, sending...
I20260808 05:03:41.534617 22464 ts_manager.cc:194] Registered new tserver with Master: e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521)
I20260808 05:03:41.535162 22464 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:49087
WARNING: no policy specified for oryx/127.11.70.195@KRBTEST.COM; defaulting to no policy
I20260808 05:03:41.541275 22997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.535026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38027 (local address 127.11.70.194:55133)
0808 05:03:41.535170 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.535180 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.535258 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.535439 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.535439 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.535650 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:41.535705 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.535707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.536726 (+ 1019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.536727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.537221 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.537222 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.537732 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.537732 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.537785 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.538212 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:41.538217 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:41.538546 (+ 329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:41.540244 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.540245 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.540245 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.540407 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.540619 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.540619 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.540620 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.540674 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.541010 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:41.541010 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:41.541045 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.541094 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.541174 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":66,"threads_started":1}
I20260808 05:03:41.541339 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.535070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:55133 (local address 127.11.70.254:38027)
0808 05:03:41.535116 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.535118 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.535244 (+ 126us) server_negotiation.cc:407] Connection header received
0808 05:03:41.535335 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.535337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.535348 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.535379 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:41.535798 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.536611 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.537313 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.537645 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.537727 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.538626 (+ 899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:41.538628 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:41.538628 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:41.538637 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:41.540146 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.540481 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.540483 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.540483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.540544 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.540741 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.540742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.540742 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.540941 (+ 199us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:41.541014 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.541120 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.541206 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab.
Entry for principal oryx/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab.
I20260808 05:03:41.557299 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38027
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab
--principal=oryx/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42051
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:41.639361 23003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:41.639571 23003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:41.639596 23003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:41.640743 23003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:41.640786 23003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:41.640807 23003 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:03:41.640851 23003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:41.642343 23003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42051
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab
--principal=oryx/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.11.70.254:38027
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:41.642612 23003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:41.642844 23003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:41.647818 23013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:41.647917 23020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:41.647846 23016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:41.648098 23003 server_base.cc:1034] running on GCE node
I20260808 05:03:41.648341 23003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:41.648536 23003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:41.649711 23003 hybrid_clock.cc:648] HybridClock initialized: now 1786165421649699 us; error 41 us; skew 500 ppm
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:41.652340 23003 init.cc:377] Logged in from keytab as oryx/127.11.70.195@KRBTEST.COM (short username oryx)
I20260808 05:03:41.652783 23003 webserver.cc:460] Webserver started at http://127.11.70.195:42309/ using document root <none> and password file <none>
I20260808 05:03:41.653012 23003 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:41.653081 23003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:41.653237 23003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:41.654294 23003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "0b01c5c06167457e86f654d6e0f78868"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "d16a313a33f5df91c3f17d1bb9896851"
server_key_iv: "46bd8afdd033849131aabb7b6e2859e5"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.654699 23003 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "0b01c5c06167457e86f654d6e0f78868"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "d16a313a33f5df91c3f17d1bb9896851"
server_key_iv: "46bd8afdd033849131aabb7b6e2859e5"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.656059 23003 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:41.656767 23032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.656999 23003 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:41.657119 23003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "0b01c5c06167457e86f654d6e0f78868"
format_stamp: "Formatted at 2026-08-08 05:03:41 on dist-test-slave-7kzw"
server_key: "d16a313a33f5df91c3f17d1bb9896851"
server_key_iv: "46bd8afdd033849131aabb7b6e2859e5"
server_key_version: "encryptionkey@0"
I20260808 05:03:41.657208 23003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:41.681281 23003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:41.683334 23003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:41.683511 23003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:41.684064 23003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:41.684131 23003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.684176 23003 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:41.684201 23003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:41.692032 23003 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:40729
I20260808 05:03:41.692266 23209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:40729 every 8 connection(s)
I20260808 05:03:41.692474 23003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:03:41.695235 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.684566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:54155 (local address 127.11.70.254:38027)
0808 05:03:41.684638 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.684640 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.684936 (+ 296us) server_negotiation.cc:407] Connection header received
0808 05:03:41.685741 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.685743 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.685763 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.685821 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:41.686821 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.687642 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.689333 (+ 1691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.689658 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.689769 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.692331 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:41.692333 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:41.692333 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:41.692341 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:41.693788 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.694212 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.694213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.694213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.694277 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.694579 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.694580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.694580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.694700 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:41.694774 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.695050 (+ 276us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.695134 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:03:41.695394 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.684573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38027 (local address 127.11.70.195:54155)
0808 05:03:41.684775 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.684831 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.685601 (+ 770us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.685916 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.685921 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.686341 (+ 420us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:41.686694 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.686703 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.687766 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.687768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.689229 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.689233 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.689785 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.689786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.689932 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.690412 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:41.690424 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:41.692245 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:41.693895 (+ 1650us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.693902 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.693904 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.694126 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.694351 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.694351 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.694352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.694516 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.694777 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:41.694785 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:41.694917 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.695014 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.695167 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":94,"threads_started":1}
I20260808 05:03:41.695907 23210 heartbeater.cc:347] Connected to a master server at 127.11.70.254:38027
I20260808 05:03:41.695989 23210 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:41.696167 23210 heartbeater.cc:511] Master 127.11.70.254:38027 requested a full tablet report, sending...
I20260808 05:03:41.696516 22463 ts_manager.cc:194] Registered new tserver with Master: 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195:40729)
I20260808 05:03:41.696925 22463 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:54155
I20260808 05:03:41.702026 23222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.696951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38027 (local address 127.11.70.195:53493)
0808 05:03:41.697134 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.697145 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.697218 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.697349 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.697349 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.697504 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:41.697563 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.697564 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.698247 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.698248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.698805 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.698807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.699157 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.699158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.699203 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.699623 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:41.699632 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:41.699898 (+ 266us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:41.701211 (+ 1313us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.701212 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.701213 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.701370 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.701540 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:41.701540 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:41.701540 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:41.701592 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:41.701798 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:41.701799 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:41.701834 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.701885 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.701957 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":124,"threads_started":1}
I20260808 05:03:41.702034 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.697018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:53493 (local address 127.11.70.254:38027)
0808 05:03:41.697053 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.697055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.697250 (+ 195us) server_negotiation.cc:407] Connection header received
0808 05:03:41.697277 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.697278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.697289 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.697347 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:41.697637 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.698155 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.698902 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.699081 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.699145 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.699970 (+ 825us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:41.699971 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:41.699971 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:41.699976 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:41.701141 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.701433 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.701434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.701434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.701484 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.701643 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.701643 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.701644 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.701746 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:41.701796 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.701921 (+ 125us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.701977 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:03:41.702548 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 23003
I20260808 05:03:41.702657 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:41.702909 11547 external_mini_cluster.cc:1428] Setting key fb401b1019dff5bbe9db573193a3427b
I20260808 05:03:41.703809 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:03:41.726581 22535 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:41.721162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54524 (local address 127.11.70.254:38027)
0808 05:03:41.721229 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.721231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.721241 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:41.721290 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.721291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.721304 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.721375 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:41.721978 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.722520 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.723277 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.723470 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.723547 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.726442 (+ 2895us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54524: BlockingRecv error: recv got EOF from 127.0.0.1:54524 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 05:03:41 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:41.733865 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.727386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54530 (local address 127.11.70.254:38027)
0808 05:03:41.727446 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.727449 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.727537 (+ 88us) server_negotiation.cc:407] Connection header received
0808 05:03:41.727610 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.727611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.727620 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.727681 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:41.728154 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.728610 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.729289 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.729474 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.729547 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.731551 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:41.731552 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:41.731553 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:41.731560 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:41.732706 (+ 1146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.733041 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.733043 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.733043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.733104 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:41.733325 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:41.733326 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:41.733327 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:41.733434 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:41.733539 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.733660 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.733732 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:03:41.735692 22463 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:41.737211 22463 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:41.743800 23248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.739622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:44567 (local address 127.0.0.1:32878)
0808 05:03:41.739958 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.739970 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.740043 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.740305 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.740306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.740308 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:41.740372 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.740374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.741341 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.741342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.742588 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.742591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.743385 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.743386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.743469 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.743484 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.743559 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.743709 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":306,"mutex_wait_us":2,"thread_start_us":96,"threads_started":1}
I20260808 05:03:41.743816 23249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.739767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32878 (local address 127.11.70.193:44567)
0808 05:03:41.739972 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.739977 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.740045 (+ 68us) server_negotiation.cc:407] Connection header received
0808 05:03:41.740173 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.740176 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.740193 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.740453 (+ 260us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:41.740522 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.741252 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.742660 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.743294 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.743385 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.743467 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.743575 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.743612 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":91,"threads_started":1}
I20260808 05:03:41.744069 23245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.739622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:40729 (local address 127.0.0.1:54556)
0808 05:03:41.739781 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.739824 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.739889 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.740279 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.740282 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.740285 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:41.740364 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.740366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.741667 (+ 1301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.741668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.742747 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.742749 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.743766 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.743768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.743848 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.743851 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.743929 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.743985 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":46,"threads_started":1}
I20260808 05:03:41.744242 23254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.739811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:43521 (local address 127.0.0.1:41412)
0808 05:03:41.740257 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.740288 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.740334 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.740583 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.740584 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.740585 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:41.740625 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.740626 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.741814 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.741815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.742831 (+ 1016us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.742833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.743921 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.743922 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.743995 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.743999 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.744100 (+ 101us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.744144 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":73,"threads_started":1}
I20260808 05:03:41.744264 23255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.740025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41412 (local address 127.11.70.194:43521)
0808 05:03:41.740223 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.740227 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.740392 (+ 165us) server_negotiation.cc:407] Connection header received
0808 05:03:41.740436 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.740438 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.740453 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.740520 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:41.740707 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.741735 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.742904 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.743575 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.743692 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.743765 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.744124 (+ 359us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.744164 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":116,"threads_started":1}
I20260808 05:03:41.744625 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.739751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54556 (local address 127.11.70.195:40729)
0808 05:03:41.740049 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.740053 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.740063 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:41.740106 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.740108 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.740123 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.740203 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:41.740447 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.741557 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.742828 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.743575 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.743652 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.743727 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.744218 (+ 491us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.744265 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":266,"thread_start_us":103,"threads_started":1}
I20260808 05:03:41.744912 22667 tablet_service.cc:1467] Processing CreateTablet for tablet 625b587912164d598b2161feeae1dc26 (DEFAULT_TABLE table=test-table [id=45e1788a9ea34bd99c0062d791c0cda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:41.744912 22877 tablet_service.cc:1467] Processing CreateTablet for tablet 625b587912164d598b2161feeae1dc26 (DEFAULT_TABLE table=test-table [id=45e1788a9ea34bd99c0062d791c0cda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:41.745177 23111 tablet_service.cc:1467] Processing CreateTablet for tablet 625b587912164d598b2161feeae1dc26 (DEFAULT_TABLE table=test-table [id=45e1788a9ea34bd99c0062d791c0cda6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:41.745297 22667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 625b587912164d598b2161feeae1dc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:41.745297 22877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 625b587912164d598b2161feeae1dc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:41.745532 23111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 625b587912164d598b2161feeae1dc26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:41.748440 23256 tablet_bootstrap.cc:492] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: Bootstrap starting.
I20260808 05:03:41.749055 23257 tablet_bootstrap.cc:492] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: Bootstrap starting.
I20260808 05:03:41.749167 23256 tablet_bootstrap.cc:654] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:41.749521 23256 log.cc:824] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:41.749725 23257 tablet_bootstrap.cc:654] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:41.750068 23257 log.cc:824] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:41.750407 23256 tablet_bootstrap.cc:492] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: No bootstrap required, opened a new log
I20260808 05:03:41.750516 23256 ts_tablet_manager.cc:1397] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:41.750810 23257 tablet_bootstrap.cc:492] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: No bootstrap required, opened a new log
I20260808 05:03:41.750905 23257 ts_tablet_manager.cc:1397] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:41.752259 23256 raft_consensus.cc:348] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } }
I20260808 05:03:41.752393 23256 raft_consensus.cc:374] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:41.752415 23256 raft_consensus.cc:729] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b01c5c06167457e86f654d6e0f78868, State: Initialized, Role: FOLLOWER
I20260808 05:03:41.752343 23257 raft_consensus.cc:348] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } }
I20260808 05:03:41.752512 23257 raft_consensus.cc:374] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:41.752556 23257 raft_consensus.cc:729] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3707e6b13c047a59c1d8d97cc7528bf, State: Initialized, Role: FOLLOWER
I20260808 05:03:41.752542 23256 consensus_queue.cc:260] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } }
I20260808 05:03:41.752686 23257 consensus_queue.cc:260] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } }
I20260808 05:03:41.752831 23256 ts_tablet_manager.cc:1428] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:41.752871 23210 heartbeater.cc:503] Master 127.11.70.254:38027 was elected leader, sending a full tablet report...
I20260808 05:03:41.752983 23257 ts_tablet_manager.cc:1428] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:41.753104 22988 heartbeater.cc:503] Master 127.11.70.254:38027 was elected leader, sending a full tablet report...
I20260808 05:03:41.753211 23260 tablet_bootstrap.cc:492] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: Bootstrap starting.
I20260808 05:03:41.753849 23260 tablet_bootstrap.cc:654] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:41.754212 23260 log.cc:824] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:41.754976 23260 tablet_bootstrap.cc:492] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: No bootstrap required, opened a new log
I20260808 05:03:41.755031 23260 ts_tablet_manager.cc:1397] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:41.756393 23260 raft_consensus.cc:348] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } }
I20260808 05:03:41.756520 23260 raft_consensus.cc:374] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:41.756541 23260 raft_consensus.cc:729] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad7b154c342430b8828e066577b7757, State: Initialized, Role: FOLLOWER
I20260808 05:03:41.756686 23260 consensus_queue.cc:260] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } }
I20260808 05:03:41.756937 23260 ts_tablet_manager.cc:1428] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:03:41.757057 22764 heartbeater.cc:503] Master 127.11.70.254:38027 was elected leader, sending a full tablet report...
W20260808 05:03:41.781026 22990 tablet.cc:2369] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:03:41.873829 22765 tablet.cc:2369] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:41.888707 23264 raft_consensus.cc:482] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:41.888839 23264 raft_consensus.cc:504] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } }
I20260808 05:03:41.889308 23264 leader_election.cc:288] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567), 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195:40729)
I20260808 05:03:41.892437 23268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.889531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:44567 (local address 127.11.70.194:52817)
0808 05:03:41.889736 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.889745 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.889782 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.889947 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.889948 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.889950 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:41.890068 (+ 118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.890070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.890847 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.890848 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.891587 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.891588 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.892168 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.892169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.892233 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.892236 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.892311 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.892350 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":139,"threads_started":1}
I20260808 05:03:41.892429 23249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.889790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:52817 (local address 127.11.70.193:44567)
0808 05:03:41.889833 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.889835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.889842 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:41.889868 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.889869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.889878 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.889928 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:41.890178 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.890758 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.891679 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.892083 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.892164 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.892176 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.892320 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.892367 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:03:41.892823 22697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625b587912164d598b2161feeae1dc26" candidate_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad7b154c342430b8828e066577b7757" is_pre_election: true
I20260808 05:03:41.892923 22816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.889513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:40729 (local address 127.11.70.194:56913)
0808 05:03:41.889572 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:41.889585 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:41.889628 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:41.889828 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:41.889829 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:41.889832 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:41.889935 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.889937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.890691 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.890692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.891494 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:41.891497 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.892078 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.892079 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:41.892742 (+ 663us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.892747 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:03:41.892815 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 05:03:41.892859 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":6}
I20260808 05:03:41.892997 22697 raft_consensus.cc:2454] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3707e6b13c047a59c1d8d97cc7528bf in term 0.
I20260808 05:03:41.892983 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.889591 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:56913 (local address 127.11.70.195:40729)
0808 05:03:41.889644 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.889646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.889657 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:41.889694 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.889695 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.889705 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.889769 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:41.890040 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.890605 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.891587 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.891980 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.892038 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.892045 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.892852 (+ 807us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.892888 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:03:41.893291 22804 leader_election.cc:302] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad7b154c342430b8828e066577b7757, e3707e6b13c047a59c1d8d97cc7528bf; no voters:
I20260808 05:03:41.893311 23140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625b587912164d598b2161feeae1dc26" candidate_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b01c5c06167457e86f654d6e0f78868" is_pre_election: true
I20260808 05:03:41.893430 23264 raft_consensus.cc:2781] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:41.893458 23140 raft_consensus.cc:2454] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3707e6b13c047a59c1d8d97cc7528bf in term 0.
I20260808 05:03:41.893492 23264 raft_consensus.cc:482] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:41.893512 23264 raft_consensus.cc:3037] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:41.894260 23264 raft_consensus.cc:504] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } }
I20260808 05:03:41.894410 23264 leader_election.cc:288] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [CANDIDATE]: Term 1 election: Requested vote from peers 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567), 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195:40729)
I20260808 05:03:41.894572 22697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625b587912164d598b2161feeae1dc26" candidate_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad7b154c342430b8828e066577b7757"
I20260808 05:03:41.894636 23140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625b587912164d598b2161feeae1dc26" candidate_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b01c5c06167457e86f654d6e0f78868"
I20260808 05:03:41.894682 22697 raft_consensus.cc:3037] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:41.894716 23140 raft_consensus.cc:3037] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:41.895416 23140 raft_consensus.cc:2454] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3707e6b13c047a59c1d8d97cc7528bf in term 1.
I20260808 05:03:41.895510 22697 raft_consensus.cc:2454] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3707e6b13c047a59c1d8d97cc7528bf in term 1.
I20260808 05:03:41.895689 22801 leader_election.cc:302] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b01c5c06167457e86f654d6e0f78868, e3707e6b13c047a59c1d8d97cc7528bf; no voters:
I20260808 05:03:41.895805 23264 raft_consensus.cc:2781] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:41.895996 23264 raft_consensus.cc:686] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 LEADER]: Becoming Leader. State: Replica: e3707e6b13c047a59c1d8d97cc7528bf, State: Running, Role: LEADER
I20260808 05:03:41.896112 23264 consensus_queue.cc:237] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } }
I20260808 05:03:41.896947 22464 catalog_manager.cc:5495] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf reported cstate change: term changed from 0 to 1, leader changed from <none> to e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194). New cstate: current_term: 1 leader_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } health_report { overall_health: HEALTHY } } }
I20260808 05:03:41.930289 23255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:41.928117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41420 (local address 127.11.70.194:43521)
0808 05:03:41.928195 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:41.928197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:41.928218 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:03:41.928252 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:41.928253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:41.928271 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:41.928324 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:41.928461 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.928923 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.929621 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:41.929799 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:41.929848 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:41.929995 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:41.930090 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:41.930148 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:41.930186 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 05:03:41.930203 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:03:41.932155 23140 raft_consensus.cc:1261] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Refusing update from remote peer e3707e6b13c047a59c1d8d97cc7528bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:41.932219 22697 raft_consensus.cc:1261] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Refusing update from remote peer e3707e6b13c047a59c1d8d97cc7528bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:41.932498 23264 consensus_queue.cc:1035] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:41.932652 23269 consensus_queue.cc:1035] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:41.935127 23273 mvcc.cc:205] Tried to move back new op lower bound from 7316133568231264256 to 7316133568087134208. Current Snapshot: MvccSnapshot[applied={T|T < 7316133568231264256}]
I20260808 05:03:41.935350 23274 mvcc.cc:205] Tried to move back new op lower bound from 7316133568231264256 to 7316133568087134208. Current Snapshot: MvccSnapshot[applied={T|T < 7316133568231264256}]
I20260808 05:03:41.938171 22464 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:41.938268 22464 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:41.939105 22464 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: Sending DeleteTablet for 3 replicas of tablet 625b587912164d598b2161feeae1dc26
I20260808 05:03:41.939527 22877 tablet_service.cc:1514] Processing DeleteTablet for tablet 625b587912164d598b2161feeae1dc26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:41 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:41412
I20260808 05:03:41.939525 23111 tablet_service.cc:1514] Processing DeleteTablet for tablet 625b587912164d598b2161feeae1dc26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:41 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:54556
I20260808 05:03:41.939536 22667 tablet_service.cc:1514] Processing DeleteTablet for tablet 625b587912164d598b2161feeae1dc26 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:41 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:32878
I20260808 05:03:41.939807 23298 tablet_replica.cc:330] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: stopping tablet replica
I20260808 05:03:41.939924 23297 tablet_replica.cc:330] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: stopping tablet replica
I20260808 05:03:41.939936 22464 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54530:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 05:03:41.940016 23297 raft_consensus.cc:2229] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260808 05:03:41.940083 22464 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:41.940137 23297 raft_consensus.cc:2258] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:41.940011 23298 raft_consensus.cc:2229] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:41.940827 23298 raft_consensus.cc:2258] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:41.940615 23297 ts_tablet_manager.cc:1905] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:41.941392 22667 tablet_service.cc:1467] Processing CreateTablet for tablet 062763d576df41fe8f1ab97a845bd2d2 (DEFAULT_TABLE table=test-table [id=b873c7d1ab35493385d2cd6e28158eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:41.941402 22877 tablet_service.cc:1467] Processing CreateTablet for tablet 062763d576df41fe8f1ab97a845bd2d2 (DEFAULT_TABLE table=test-table [id=b873c7d1ab35493385d2cd6e28158eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:41.941522 22877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062763d576df41fe8f1ab97a845bd2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:41.941521 22667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062763d576df41fe8f1ab97a845bd2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:41.941515 23111 tablet_service.cc:1467] Processing CreateTablet for tablet 062763d576df41fe8f1ab97a845bd2d2 (DEFAULT_TABLE table=test-table [id=b873c7d1ab35493385d2cd6e28158eac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:41.941605 23111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 062763d576df41fe8f1ab97a845bd2d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:41.943070 23257 tablet_bootstrap.cc:492] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: Bootstrap starting.
I20260808 05:03:41.943089 23260 tablet_bootstrap.cc:492] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: Bootstrap starting.
I20260808 05:03:41.943140 23256 tablet_bootstrap.cc:492] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: Bootstrap starting.
I20260808 05:03:41.943480 23260 tablet_bootstrap.cc:654] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:41.943622 23257 tablet_bootstrap.cc:654] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:41.943907 23256 tablet_bootstrap.cc:654] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:41.944419 23257 tablet_bootstrap.cc:492] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: No bootstrap required, opened a new log
I20260808 05:03:41.944469 23257 ts_tablet_manager.cc:1397] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:41.944743 23257 raft_consensus.cc:348] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:41.944841 23257 raft_consensus.cc:374] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:41.944871 23257 raft_consensus.cc:729] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3707e6b13c047a59c1d8d97cc7528bf, State: Initialized, Role: FOLLOWER
I20260808 05:03:41.944913 23257 consensus_queue.cc:260] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:41.945005 23257 ts_tablet_manager.cc:1428] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:41.945714 23298 ts_tablet_manager.cc:1905] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:41.945878 23297 ts_tablet_manager.cc:1918] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:41.945955 23297 log.cc:1196] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/625b587912164d598b2161feeae1dc26
I20260808 05:03:41.946280 23297 ts_tablet_manager.cc:1939] T 625b587912164d598b2161feeae1dc26 P 0b01c5c06167457e86f654d6e0f78868: Deleting consensus metadata
I20260808 05:03:41.946784 23291 tablet_replica.cc:330] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: stopping tablet replica
I20260808 05:03:41.946849 22438 catalog_manager.cc:4841] TS 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195:40729): tablet 625b587912164d598b2161feeae1dc26 (table test-table [id=45e1788a9ea34bd99c0062d791c0cda6]) successfully deleted
I20260808 05:03:41.946911 23291 raft_consensus.cc:2229] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:41.947028 23291 raft_consensus.cc:2258] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:41.947497 23291 ts_tablet_manager.cc:1905] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:41.947630 23260 tablet_bootstrap.cc:492] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: No bootstrap required, opened a new log
I20260808 05:03:41.947690 23260 ts_tablet_manager.cc:1397] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 05:03:41.947866 23260 raft_consensus.cc:348] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:41.947954 23260 raft_consensus.cc:374] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:41.947983 23260 raft_consensus.cc:729] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad7b154c342430b8828e066577b7757, State: Initialized, Role: FOLLOWER
I20260808 05:03:41.948037 23260 consensus_queue.cc:260] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:41.948176 23260 ts_tablet_manager.cc:1428] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:41.948438 23298 ts_tablet_manager.cc:1918] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:41.948567 23298 log.cc:1196] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/625b587912164d598b2161feeae1dc26
I20260808 05:03:41.948925 23298 ts_tablet_manager.cc:1939] T 625b587912164d598b2161feeae1dc26 P e3707e6b13c047a59c1d8d97cc7528bf: Deleting consensus metadata
I20260808 05:03:41.949079 23291 ts_tablet_manager.cc:1918] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:41.949169 23291 log.cc:1196] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/625b587912164d598b2161feeae1dc26
I20260808 05:03:41.949349 22438 catalog_manager.cc:4841] TS e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521): tablet 625b587912164d598b2161feeae1dc26 (table test-table [id=45e1788a9ea34bd99c0062d791c0cda6]) successfully deleted
I20260808 05:03:41.949520 23256 tablet_bootstrap.cc:492] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: No bootstrap required, opened a new log
I20260808 05:03:41.949597 23256 ts_tablet_manager.cc:1397] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 05:03:41.949759 23256 raft_consensus.cc:348] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:41.949790 23291 ts_tablet_manager.cc:1939] T 625b587912164d598b2161feeae1dc26 P 0ad7b154c342430b8828e066577b7757: Deleting consensus metadata
I20260808 05:03:41.949838 23256 raft_consensus.cc:374] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:41.949868 23256 raft_consensus.cc:729] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b01c5c06167457e86f654d6e0f78868, State: Initialized, Role: FOLLOWER
I20260808 05:03:41.949909 23256 consensus_queue.cc:260] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:41.950002 23256 ts_tablet_manager.cc:1428] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:41.950182 22439 catalog_manager.cc:4841] TS 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567): tablet 625b587912164d598b2161feeae1dc26 (table test-table [id=45e1788a9ea34bd99c0062d791c0cda6]) successfully deleted
I20260808 05:03:42.044505 23263 raft_consensus.cc:482] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:42.044646 23263 raft_consensus.cc:504] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.045024 23263 leader_election.cc:288] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567), e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521)
I20260808 05:03:42.048767 23052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.045214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:44567 (local address 127.11.70.195:60119)
0808 05:03:42.045283 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:42.045296 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:42.045345 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:42.045573 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:42.045575 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:42.045577 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:42.045662 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.045664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.046627 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.046628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.047848 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.047851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.048447 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.048448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.048534 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.048537 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:42.048628 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 05:03:42.048673 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":13}
I20260808 05:03:42.048839 23249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.045275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:60119 (local address 127.11.70.193:44567)
0808 05:03:42.045320 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.045322 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.045333 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:42.045435 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.045437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.045448 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.045513 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:42.045745 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.046535 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.047973 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.048348 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.048447 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.048458 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.048685 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.048754 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:03:42.048949 23255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.045304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:41641 (local address 127.11.70.194:43521)
0808 05:03:42.045359 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.045361 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.045542 (+ 181us) server_negotiation.cc:407] Connection header received
0808 05:03:42.045645 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.045646 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.045657 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.045726 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:42.045920 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.046396 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.047957 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.048539 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.048625 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.048634 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.048809 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.048860 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:03:42.049062 22697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062763d576df41fe8f1ab97a845bd2d2" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad7b154c342430b8828e066577b7757" is_pre_election: true
I20260808 05:03:42.049160 22697 raft_consensus.cc:2454] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 0.
I20260808 05:03:42.049176 23303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.045219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:43521 (local address 127.11.70.195:41641)
0808 05:03:42.045484 (+ 265us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:42.045494 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:42.045551 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:42.045731 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:42.045732 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:42.045734 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:42.045835 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.045836 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.046514 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.046515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.047848 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.047851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.048656 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.048657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.048716 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.048720 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:42.049028 (+ 308us) client_negotiation.cc:240] Negotiation successful
0808 05:03:42.049085 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"mutex_wait_us":170,"thread_start_us":68,"threads_started":1}
I20260808 05:03:42.049414 23036 leader_election.cc:302] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad7b154c342430b8828e066577b7757, 0b01c5c06167457e86f654d6e0f78868; no voters:
I20260808 05:03:42.049448 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062763d576df41fe8f1ab97a845bd2d2" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" is_pre_election: true
I20260808 05:03:42.049566 22907 raft_consensus.cc:2454] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 0.
I20260808 05:03:42.049564 23263 raft_consensus.cc:2781] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:42.049626 23263 raft_consensus.cc:482] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:42.049650 23263 raft_consensus.cc:3037] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.050915 23263 raft_consensus.cc:504] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.051101 23263 leader_election.cc:288] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567), e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521)
I20260808 05:03:42.051301 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062763d576df41fe8f1ab97a845bd2d2" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3707e6b13c047a59c1d8d97cc7528bf"
I20260808 05:03:42.051319 22697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "062763d576df41fe8f1ab97a845bd2d2" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad7b154c342430b8828e066577b7757"
I20260808 05:03:42.051402 22697 raft_consensus.cc:3037] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.051400 22907 raft_consensus.cc:3037] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.052116 22907 raft_consensus.cc:2454] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 1.
I20260808 05:03:42.052351 23033 leader_election.cc:302] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b01c5c06167457e86f654d6e0f78868, e3707e6b13c047a59c1d8d97cc7528bf; no voters:
I20260808 05:03:42.052367 22697 raft_consensus.cc:2454] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 1.
I20260808 05:03:42.052556 23263 raft_consensus.cc:2781] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:42.052721 23263 raft_consensus.cc:686] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 1 LEADER]: Becoming Leader. State: Replica: 0b01c5c06167457e86f654d6e0f78868, State: Running, Role: LEADER
I20260808 05:03:42.052795 23263 consensus_queue.cc:237] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.053509 22463 catalog_manager.cc:5495] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "0b01c5c06167457e86f654d6e0f78868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } health_report { overall_health: HEALTHY } } }
Aug 08 05:03:42 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165421, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.254@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:42.086572 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.079287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54538 (local address 127.11.70.254:38027)
0808 05:03:42.079379 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.079381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.079500 (+ 119us) server_negotiation.cc:407] Connection header received
0808 05:03:42.079572 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.079573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.079584 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.079636 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:42.080206 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.080732 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.081452 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.081655 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.081734 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.083832 (+ 2098us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:42.083834 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:42.083834 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:42.083841 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:42.085243 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:42.085679 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:42.085680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:42.085680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:42.085736 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:42.085970 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:42.085971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:42.085971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:42.086079 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:42.086162 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.086317 (+ 155us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.086433 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":64}
I20260808 05:03:42.086659 23314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.079229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38027 (local address 127.0.0.1:54538)
0808 05:03:42.079415 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:42.079426 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:42.079519 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:42.079640 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:42.079640 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:42.080000 (+ 360us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:42.080049 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.080053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.080835 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.080837 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.081366 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.081368 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.081731 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.081732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.081785 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.082303 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:42.082309 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:42.083735 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:42.085347 (+ 1612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:42.085355 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:42.085358 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:42.085600 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:42.085802 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:42.085803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:42.085803 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:42.085861 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:42.086153 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:42.086161 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:42.086207 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 05:03:42.086294 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:03:42.086522 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":95,"thread_start_us":100,"threads_started":1}
I20260808 05:03:42.088742 22463 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:54538:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 05:03:42.088932 22463 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:42.090492 23111 tablet_service.cc:1467] Processing CreateTablet for tablet aff5533c21e5475bac43ef61607ffd70 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2caecedec6e44164959ce24dd157662e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:03:42.090487 22667 tablet_service.cc:1467] Processing CreateTablet for tablet aff5533c21e5475bac43ef61607ffd70 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2caecedec6e44164959ce24dd157662e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:03:42.090525 22877 tablet_service.cc:1467] Processing CreateTablet for tablet aff5533c21e5475bac43ef61607ffd70 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=2caecedec6e44164959ce24dd157662e]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:03:42.090670 23111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aff5533c21e5475bac43ef61607ffd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:42.090664 22667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aff5533c21e5475bac43ef61607ffd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:42.090699 22877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aff5533c21e5475bac43ef61607ffd70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:42.091826 23257 tablet_bootstrap.cc:492] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: Bootstrap starting.
I20260808 05:03:42.092195 23256 tablet_bootstrap.cc:492] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: Bootstrap starting.
I20260808 05:03:42.092211 23257 tablet_bootstrap.cc:654] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:42.092612 23260 tablet_bootstrap.cc:492] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: Bootstrap starting.
I20260808 05:03:42.092988 23257 tablet_bootstrap.cc:492] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: No bootstrap required, opened a new log
I20260808 05:03:42.093044 23257 ts_tablet_manager.cc:1397] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:42.093190 23260 tablet_bootstrap.cc:654] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:42.093185 23257 raft_consensus.cc:348] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.093290 23257 raft_consensus.cc:374] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:42.093319 23257 raft_consensus.cc:729] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3707e6b13c047a59c1d8d97cc7528bf, State: Initialized, Role: FOLLOWER
I20260808 05:03:42.093379 23257 consensus_queue.cc:260] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.093495 23257 ts_tablet_manager.cc:1428] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:42.093580 23269 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.093662 23269 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:42.093917 23260 tablet_bootstrap.cc:492] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: No bootstrap required, opened a new log
I20260808 05:03:42.093977 23260 ts_tablet_manager.cc:1397] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:42.094028 23256 tablet_bootstrap.cc:654] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:42.094141 23260 raft_consensus.cc:348] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.094234 23260 raft_consensus.cc:374] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:42.094269 23260 raft_consensus.cc:729] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad7b154c342430b8828e066577b7757, State: Initialized, Role: FOLLOWER
I20260808 05:03:42.094324 23260 consensus_queue.cc:260] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.094453 23260 ts_tablet_manager.cc:1428] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:42.094520 23266 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.094606 23266 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:42.094808 23256 tablet_bootstrap.cc:492] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: No bootstrap required, opened a new log
I20260808 05:03:42.094863 23256 ts_tablet_manager.cc:1397] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 05:03:42.095042 23256 raft_consensus.cc:348] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.095130 23256 raft_consensus.cc:374] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:42.095170 23256 raft_consensus.cc:729] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b01c5c06167457e86f654d6e0f78868, State: Initialized, Role: FOLLOWER
I20260808 05:03:42.095216 23256 consensus_queue.cc:260] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.095324 23256 ts_tablet_manager.cc:1428] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:42.095395 23263 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.095522 23263 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:42.113798 23266 raft_consensus.cc:482] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:42.113900 23266 raft_consensus.cc:504] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.114243 23266 leader_election.cc:288] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521), 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195:40729)
I20260808 05:03:42.117427 23255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.114441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:57465 (local address 127.11.70.194:43521)
0808 05:03:42.114667 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.114670 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.114759 (+ 89us) server_negotiation.cc:407] Connection header received
0808 05:03:42.114835 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.114836 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.114849 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.114906 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:42.115076 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.115612 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.116697 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.117065 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.117121 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.117160 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.117308 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.117352 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":193}
I20260808 05:03:42.117444 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.114749 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:57999 (local address 127.11.70.195:40729)
0808 05:03:42.114798 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.114800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.114902 (+ 102us) server_negotiation.cc:407] Connection header received
0808 05:03:42.114961 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.114962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.114973 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.115031 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:03:42.115210 (+ 179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.115687 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.116708 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.117073 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.117162 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.117170 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.117347 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.117383 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:03:42.117442 23318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.114424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:43521 (local address 127.11.70.193:57465)
0808 05:03:42.114676 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:42.114688 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:42.114770 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:42.114915 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:42.114916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:42.114918 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:42.115006 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.115008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.115688 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.115689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.116596 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.116598 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.117146 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.117148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.117235 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.117239 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:03:42.117283 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:03:42.117338 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":30,"thread_start_us":109,"threads_started":1}
I20260808 05:03:42.117460 23319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.114650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:40729 (local address 127.11.70.193:57999)
0808 05:03:42.114825 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:42.114836 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:42.114898 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:42.115058 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:42.115059 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:42.115061 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:03:42.115140 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.115142 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.115771 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.115772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.116598 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.116600 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.117179 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.117180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.117252 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.117255 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:03:42.117327 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 05:03:42.117364 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":47,"thread_start_us":97,"threads_started":1}
I20260808 05:03:42.117902 23140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff5533c21e5475bac43ef61607ffd70" candidate_uuid: "0ad7b154c342430b8828e066577b7757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b01c5c06167457e86f654d6e0f78868" is_pre_election: true
I20260808 05:03:42.117901 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff5533c21e5475bac43ef61607ffd70" candidate_uuid: "0ad7b154c342430b8828e066577b7757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" is_pre_election: true
I20260808 05:03:42.117992 23140 raft_consensus.cc:2454] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad7b154c342430b8828e066577b7757 in term 0.
I20260808 05:03:42.117992 22907 raft_consensus.cc:2454] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ad7b154c342430b8828e066577b7757 in term 0.
I20260808 05:03:42.118157 22592 leader_election.cc:302] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad7b154c342430b8828e066577b7757, 0b01c5c06167457e86f654d6e0f78868; no voters:
I20260808 05:03:42.118294 23266 raft_consensus.cc:2781] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:42.118335 23266 raft_consensus.cc:482] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:42.118350 23266 raft_consensus.cc:3037] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.119105 23266 raft_consensus.cc:504] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.119243 23266 leader_election.cc:288] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [CANDIDATE]: Term 1 election: Requested vote from peers e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521), 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195:40729)
I20260808 05:03:42.119437 23140 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff5533c21e5475bac43ef61607ffd70" candidate_uuid: "0ad7b154c342430b8828e066577b7757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0b01c5c06167457e86f654d6e0f78868"
I20260808 05:03:42.119434 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aff5533c21e5475bac43ef61607ffd70" candidate_uuid: "0ad7b154c342430b8828e066577b7757" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3707e6b13c047a59c1d8d97cc7528bf"
I20260808 05:03:42.119508 23140 raft_consensus.cc:3037] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.119508 22907 raft_consensus.cc:3037] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.120330 22907 raft_consensus.cc:2454] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad7b154c342430b8828e066577b7757 in term 1.
I20260808 05:03:42.120615 23140 raft_consensus.cc:2454] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ad7b154c342430b8828e066577b7757 in term 1.
I20260808 05:03:42.120784 22592 leader_election.cc:302] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ad7b154c342430b8828e066577b7757, 0b01c5c06167457e86f654d6e0f78868; no voters:
I20260808 05:03:42.120903 23266 raft_consensus.cc:2781] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:42.121057 23266 raft_consensus.cc:686] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [term 1 LEADER]: Becoming Leader. State: Replica: 0ad7b154c342430b8828e066577b7757, State: Running, Role: LEADER
I20260808 05:03:42.121157 23266 consensus_queue.cc:237] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.121548 23320 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: TxnStatusTablet state changed. Reason: New leader 0ad7b154c342430b8828e066577b7757. Latest consensus state: current_term: 1 leader_uuid: "0ad7b154c342430b8828e066577b7757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.121649 23320 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:03:42.121840 23322 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 05:03:42.121978 23322 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 05:03:42.121903 22464 catalog_manager.cc:5495] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ad7b154c342430b8828e066577b7757 (127.11.70.193). New cstate: current_term: 1 leader_uuid: "0ad7b154c342430b8828e066577b7757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } health_report { overall_health: UNKNOWN } } }
I20260808 05:03:42.133565 23249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.131127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32888 (local address 127.11.70.193:44567)
0808 05:03:42.131187 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.131188 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.131196 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:42.131226 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.131227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.131263 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.131335 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:42.131497 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.131954 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.132714 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.132917 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.132992 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.133191 (+ 199us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:42.133330 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:42.133412 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.133473 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.133491 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:03:42.133598 23314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.130892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:44567 (local address 127.0.0.1:32888)
0808 05:03:42.130972 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:42.130985 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:42.131037 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:42.131358 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:42.131359 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:42.131361 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:42.131408 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.131410 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.132040 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.132042 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.132606 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.132608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.132993 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.132994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.133067 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.133091 (+ 24us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:42.133398 (+ 307us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:42.133410 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 05:03:42.133467 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:03:42.133520 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 05:03:42.134986 23140 raft_consensus.cc:1261] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Refusing update from remote peer 0ad7b154c342430b8828e066577b7757: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:42.135058 22907 raft_consensus.cc:1261] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Refusing update from remote peer 0ad7b154c342430b8828e066577b7757: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:42.135263 23266 consensus_queue.cc:1035] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:42.135553 23266 consensus_queue.cc:1035] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:42.136103 23263 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: TxnStatusTablet state changed. Reason: New leader 0ad7b154c342430b8828e066577b7757. Latest consensus state: current_term: 1 leader_uuid: "0ad7b154c342430b8828e066577b7757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.136219 23263 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:42.136162 23269 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: TxnStatusTablet state changed. Reason: New leader 0ad7b154c342430b8828e066577b7757. Latest consensus state: current_term: 1 leader_uuid: "0ad7b154c342430b8828e066577b7757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.136279 23269 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:42.136727 23266 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ad7b154c342430b8828e066577b7757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.136821 23266 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:03:42.137413 23266 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0ad7b154c342430b8828e066577b7757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.137442 23275 mvcc.cc:205] Tried to move back new op lower bound from 7316133569062858752 to 7316133569008852992. Current Snapshot: MvccSnapshot[applied={T|T < 7316133569062858752 or (T in {7316133569062858752})}]
I20260808 05:03:42.137491 23266 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P 0ad7b154c342430b8828e066577b7757: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:03:42.137542 23263 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0ad7b154c342430b8828e066577b7757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.137610 23263 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P 0b01c5c06167457e86f654d6e0f78868: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:42.138293 23269 tablet_replica.cc:439] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0ad7b154c342430b8828e066577b7757" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } } }
I20260808 05:03:42.138377 23269 tablet_replica.cc:442] T aff5533c21e5475bac43ef61607ffd70 P e3707e6b13c047a59c1d8d97cc7528bf: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:03:42.141567 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.139096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54566 (local address 127.11.70.195:40729)
0808 05:03:42.139161 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.139164 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.139172 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:42.139204 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.139205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.139231 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.139302 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:42.139387 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.140099 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.140781 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.141081 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.141152 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.141275 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:42.141388 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:42.141455 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.141478 (+ 23us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.141496 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:03:42.146353 23249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.144092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:54399 (local address 127.11.70.193:44567)
0808 05:03:42.144161 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.144163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.144172 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:42.144216 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.144217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.144226 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.144298 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:42.144439 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.144881 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.145617 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.145809 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.145884 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.146067 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:42.146101 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:42.146197 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.146264 (+ 67us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.146283 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:03:42.146373 23222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.144007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:44567 (local address 127.11.70.195:54399)
0808 05:03:42.144096 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:42.144109 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:42.144159 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:42.144301 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:42.144302 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:42.144303 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:42.144360 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.144362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.144965 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.144966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.145530 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.145532 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.145884 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.145885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.145951 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.145973 (+ 22us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:42.146202 (+ 229us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:42.146204 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:03:42.146258 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:03:42.146300 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260808 05:03:42.148540 22697 raft_consensus.cc:1261] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Refusing update from remote peer 0b01c5c06167457e86f654d6e0f78868: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:42.148581 22907 raft_consensus.cc:1261] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Refusing update from remote peer 0b01c5c06167457e86f654d6e0f78868: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:42.148770 23263 consensus_queue.cc:1035] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:42.148905 23304 consensus_queue.cc:1035] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:42.157414 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.154553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:51871 (local address 127.11.70.195:40729)
0808 05:03:42.154687 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.154689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.154737 (+ 48us) server_negotiation.cc:407] Connection header received
0808 05:03:42.154784 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.154785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.154794 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.154856 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:42.154936 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.155633 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.156585 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.156931 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.157016 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.157174 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:42.157205 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:42.157265 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.157312 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.157330 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260808 05:03:42.157435 23339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.154522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:40729 (local address 127.11.70.193:51871)
0808 05:03:42.154687 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:42.154697 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:42.154746 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:42.154857 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:42.154858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:42.154859 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:03:42.154902 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.154903 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.155707 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.155708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.156512 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:42.156515 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.157034 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.157034 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:42.157082 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.157096 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:03:42.157273 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:03:42.157275 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:03:42.157310 (+ 35us) client_negotiation.cc:240] Negotiation successful
0808 05:03:42.157341 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260808 05:03:42.166850 22463 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:42.166970 22463 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54530:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:42.167606 22463 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: Sending DeleteTablet for 3 replicas of tablet 062763d576df41fe8f1ab97a845bd2d2
I20260808 05:03:42.167932 22877 tablet_service.cc:1514] Processing DeleteTablet for tablet 062763d576df41fe8f1ab97a845bd2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:42 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:41412
I20260808 05:03:42.167987 22667 tablet_service.cc:1514] Processing DeleteTablet for tablet 062763d576df41fe8f1ab97a845bd2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:42 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:32878
I20260808 05:03:42.168047 23298 tablet_replica.cc:330] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: stopping tablet replica
I20260808 05:03:42.168067 23111 tablet_service.cc:1514] Processing DeleteTablet for tablet 062763d576df41fe8f1ab97a845bd2d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:42 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:54556
I20260808 05:03:42.168130 23298 raft_consensus.cc:2229] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:42.168143 23291 tablet_replica.cc:330] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: stopping tablet replica
I20260808 05:03:42.168175 23298 raft_consensus.cc:2258] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:42.168190 23291 raft_consensus.cc:2229] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:42.168223 23291 raft_consensus.cc:2258] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:42.168284 23297 tablet_replica.cc:330] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: stopping tablet replica
I20260808 05:03:42.168336 23297 raft_consensus.cc:2229] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:42.168423 23297 raft_consensus.cc:2258] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:42.168515 23298 ts_tablet_manager.cc:1905] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:42.168789 23291 ts_tablet_manager.cc:1905] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:42.170153 23298 ts_tablet_manager.cc:1918] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:42.170207 23298 log.cc:1196] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/062763d576df41fe8f1ab97a845bd2d2
I20260808 05:03:42.170430 23298 ts_tablet_manager.cc:1939] T 062763d576df41fe8f1ab97a845bd2d2 P e3707e6b13c047a59c1d8d97cc7528bf: Deleting consensus metadata
I20260808 05:03:42.170953 23297 ts_tablet_manager.cc:1905] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:42.171398 23291 ts_tablet_manager.cc:1918] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:42.171459 23291 log.cc:1196] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/062763d576df41fe8f1ab97a845bd2d2
I20260808 05:03:42.171725 23291 ts_tablet_manager.cc:1939] T 062763d576df41fe8f1ab97a845bd2d2 P 0ad7b154c342430b8828e066577b7757: Deleting consensus metadata
I20260808 05:03:42.172183 22439 catalog_manager.cc:4841] TS 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567): tablet 062763d576df41fe8f1ab97a845bd2d2 (table test-table [id=b873c7d1ab35493385d2cd6e28158eac]) successfully deleted
I20260808 05:03:42.172456 23297 ts_tablet_manager.cc:1918] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:42.172519 23297 log.cc:1196] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/062763d576df41fe8f1ab97a845bd2d2
I20260808 05:03:42.172745 23297 ts_tablet_manager.cc:1939] T 062763d576df41fe8f1ab97a845bd2d2 P 0b01c5c06167457e86f654d6e0f78868: Deleting consensus metadata
I20260808 05:03:42.173074 22438 catalog_manager.cc:4841] TS e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521): tablet 062763d576df41fe8f1ab97a845bd2d2 (table test-table [id=b873c7d1ab35493385d2cd6e28158eac]) successfully deleted
I20260808 05:03:42.173148 22438 catalog_manager.cc:4841] TS 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195:40729): tablet 062763d576df41fe8f1ab97a845bd2d2 (table test-table [id=b873c7d1ab35493385d2cd6e28158eac]) successfully deleted
Aug 08 05:03:42 dist-test-slave-7kzw krb5kdc[22394](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:03:42 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:42 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:03:42.209534 22535 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:42.199088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54540 (local address 127.11.70.254:38027)
0808 05:03:42.199134 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.199136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.202673 (+ 3537us) server_negotiation.cc:407] Connection header received
0808 05:03:42.202742 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.202743 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.202757 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.202827 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:42.203565 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.204311 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.205429 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.205715 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.205799 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.209462 (+ 3663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54540: BlockingRecv error: recv got EOF from 127.0.0.1:54540 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 05:03:42 dist-test-slave-7kzw krb5kdc[22394](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165422, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM
I20260808 05:03:42.219369 22535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.210617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54542 (local address 127.11.70.254:38027)
0808 05:03:42.210664 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.210666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.210895 (+ 229us) server_negotiation.cc:407] Connection header received
0808 05:03:42.210943 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.210944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.210956 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.211016 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:42.211577 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.212300 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.213318 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.213592 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.213667 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.216325 (+ 2658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:42.216326 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:42.216326 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:42.216334 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:42.218031 (+ 1697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:42.218456 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:42.218457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:42.218457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:42.218556 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:42.218795 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:42.218795 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:42.218796 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:42.218934 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:42.219040 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.219187 (+ 147us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.219270 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:03:42.221186 22463 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:03:42.221367 22463 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:42.222867 23111 tablet_service.cc:1467] Processing CreateTablet for tablet 5e7acb407db14fbcba9cd099461e7d08 (DEFAULT_TABLE table=test-table [id=377b886f78e3404885525238213bf776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:42.222888 22667 tablet_service.cc:1467] Processing CreateTablet for tablet 5e7acb407db14fbcba9cd099461e7d08 (DEFAULT_TABLE table=test-table [id=377b886f78e3404885525238213bf776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:42.222882 22877 tablet_service.cc:1467] Processing CreateTablet for tablet 5e7acb407db14fbcba9cd099461e7d08 (DEFAULT_TABLE table=test-table [id=377b886f78e3404885525238213bf776]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:42.223016 22667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e7acb407db14fbcba9cd099461e7d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:42.223016 22877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e7acb407db14fbcba9cd099461e7d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:42.223016 23111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e7acb407db14fbcba9cd099461e7d08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:42.224365 23257 tablet_bootstrap.cc:492] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: Bootstrap starting.
I20260808 05:03:42.224645 23260 tablet_bootstrap.cc:492] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: Bootstrap starting.
I20260808 05:03:42.224789 23257 tablet_bootstrap.cc:654] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:42.224994 23260 tablet_bootstrap.cc:654] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:42.225354 23256 tablet_bootstrap.cc:492] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: Bootstrap starting.
I20260808 05:03:42.225363 23257 tablet_bootstrap.cc:492] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: No bootstrap required, opened a new log
I20260808 05:03:42.225409 23257 ts_tablet_manager.cc:1397] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:42.225515 23257 raft_consensus.cc:348] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.225581 23257 raft_consensus.cc:374] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:42.225601 23257 raft_consensus.cc:729] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3707e6b13c047a59c1d8d97cc7528bf, State: Initialized, Role: FOLLOWER
I20260808 05:03:42.225646 23257 consensus_queue.cc:260] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.225752 23257 ts_tablet_manager.cc:1428] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:42.225772 23256 tablet_bootstrap.cc:654] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:42.226845 23256 tablet_bootstrap.cc:492] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: No bootstrap required, opened a new log
I20260808 05:03:42.226897 23256 ts_tablet_manager.cc:1397] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:03:42.227030 23256 raft_consensus.cc:348] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.227095 23256 raft_consensus.cc:374] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:42.227118 23256 raft_consensus.cc:729] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b01c5c06167457e86f654d6e0f78868, State: Initialized, Role: FOLLOWER
I20260808 05:03:42.227180 23256 consensus_queue.cc:260] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.227285 23256 ts_tablet_manager.cc:1428] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:42.227650 23260 tablet_bootstrap.cc:492] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: No bootstrap required, opened a new log
I20260808 05:03:42.227702 23260 ts_tablet_manager.cc:1397] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 05:03:42.227856 23260 raft_consensus.cc:348] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.227918 23260 raft_consensus.cc:374] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:42.227938 23260 raft_consensus.cc:729] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad7b154c342430b8828e066577b7757, State: Initialized, Role: FOLLOWER
I20260808 05:03:42.227979 23260 consensus_queue.cc:260] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.228067 23260 ts_tablet_manager.cc:1428] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:42.315310 23263 raft_consensus.cc:482] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:42.315416 23263 raft_consensus.cc:504] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.315625 23263 leader_election.cc:288] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567), e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521)
I20260808 05:03:42.315866 22697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e7acb407db14fbcba9cd099461e7d08" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad7b154c342430b8828e066577b7757" is_pre_election: true
I20260808 05:03:42.315879 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e7acb407db14fbcba9cd099461e7d08" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" is_pre_election: true
I20260808 05:03:42.315980 22697 raft_consensus.cc:2454] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 0.
I20260808 05:03:42.315977 22907 raft_consensus.cc:2454] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 0.
I20260808 05:03:42.316198 23033 leader_election.cc:302] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b01c5c06167457e86f654d6e0f78868, e3707e6b13c047a59c1d8d97cc7528bf; no voters:
I20260808 05:03:42.316345 23263 raft_consensus.cc:2781] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:42.316438 23263 raft_consensus.cc:482] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:42.316470 23263 raft_consensus.cc:3037] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.317147 23263 raft_consensus.cc:504] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.317309 23263 leader_election.cc:288] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567), e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521)
I20260808 05:03:42.317433 22697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e7acb407db14fbcba9cd099461e7d08" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad7b154c342430b8828e066577b7757"
I20260808 05:03:42.317536 22697 raft_consensus.cc:3037] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.317533 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e7acb407db14fbcba9cd099461e7d08" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3707e6b13c047a59c1d8d97cc7528bf"
I20260808 05:03:42.317610 22907 raft_consensus.cc:3037] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.318377 22907 raft_consensus.cc:2454] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 1.
I20260808 05:03:42.318370 22697 raft_consensus.cc:2454] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 1.
I20260808 05:03:42.318574 23033 leader_election.cc:302] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b01c5c06167457e86f654d6e0f78868, e3707e6b13c047a59c1d8d97cc7528bf; no voters:
I20260808 05:03:42.318675 23263 raft_consensus.cc:2781] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:42.318737 23263 raft_consensus.cc:686] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 1 LEADER]: Becoming Leader. State: Replica: 0b01c5c06167457e86f654d6e0f78868, State: Running, Role: LEADER
I20260808 05:03:42.318785 23263 consensus_queue.cc:237] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.319427 22463 catalog_manager.cc:5495] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "0b01c5c06167457e86f654d6e0f78868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } health_report { overall_health: HEALTHY } } }
I20260808 05:03:42.325063 23251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.322679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54572 (local address 127.11.70.195:40729)
0808 05:03:42.322763 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:42.322766 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:42.322778 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:03:42.322875 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:42.322876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:42.322888 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:42.322933 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:03:42.323094 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.323565 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.324363 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:42.324576 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:42.324658 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:42.324810 (+ 152us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:03:42.324844 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:03:42.324896 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:42.324962 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 05:03:42.324982 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260808 05:03:42.325794 22907 raft_consensus.cc:1261] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Refusing update from remote peer 0b01c5c06167457e86f654d6e0f78868: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:42.325825 22697 raft_consensus.cc:1261] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Refusing update from remote peer 0b01c5c06167457e86f654d6e0f78868: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:42.326009 23334 consensus_queue.cc:1035] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:42.326123 23263 consensus_queue.cc:1035] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:42.328666 22463 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:42.328766 22463 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:42.329367 22463 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: Sending DeleteTablet for 3 replicas of tablet 5e7acb407db14fbcba9cd099461e7d08
I20260808 05:03:42.329587 22667 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e7acb407db14fbcba9cd099461e7d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:42 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:32878
I20260808 05:03:42.329633 22877 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e7acb407db14fbcba9cd099461e7d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:42 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:41412
I20260808 05:03:42.329689 23291 tablet_replica.cc:330] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: stopping tablet replica
I20260808 05:03:42.329753 23291 raft_consensus.cc:2229] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:42.329734 23111 tablet_service.cc:1514] Processing DeleteTablet for tablet 5e7acb407db14fbcba9cd099461e7d08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:42 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:54556
I20260808 05:03:42.329802 23291 raft_consensus.cc:2258] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:42.329824 23298 tablet_replica.cc:330] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: stopping tablet replica
I20260808 05:03:42.329780 22463 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54542:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 05:03:42.329886 23298 raft_consensus.cc:2229] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:42.329928 23298 raft_consensus.cc:2258] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 05:03:42.329921 22463 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:03:42.330001 23297 tablet_replica.cc:330] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: stopping tablet replica
I20260808 05:03:42.330063 23297 raft_consensus.cc:2229] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:42.330127 23297 raft_consensus.cc:2258] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:42.330236 23291 ts_tablet_manager.cc:1905] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:42.330354 23297 ts_tablet_manager.cc:1905] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:42.330637 23298 ts_tablet_manager.cc:1905] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:42.331694 23298 ts_tablet_manager.cc:1918] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:42.331735 23298 log.cc:1196] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/5e7acb407db14fbcba9cd099461e7d08
I20260808 05:03:42.331750 23297 ts_tablet_manager.cc:1918] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:42.331782 23291 ts_tablet_manager.cc:1918] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:03:42.331806 23297 log.cc:1196] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/5e7acb407db14fbcba9cd099461e7d08
I20260808 05:03:42.331831 23291 log.cc:1196] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/5e7acb407db14fbcba9cd099461e7d08
I20260808 05:03:42.331902 23298 ts_tablet_manager.cc:1939] T 5e7acb407db14fbcba9cd099461e7d08 P e3707e6b13c047a59c1d8d97cc7528bf: Deleting consensus metadata
I20260808 05:03:42.332043 23297 ts_tablet_manager.cc:1939] T 5e7acb407db14fbcba9cd099461e7d08 P 0b01c5c06167457e86f654d6e0f78868: Deleting consensus metadata
I20260808 05:03:42.332072 23291 ts_tablet_manager.cc:1939] T 5e7acb407db14fbcba9cd099461e7d08 P 0ad7b154c342430b8828e066577b7757: Deleting consensus metadata
I20260808 05:03:42.332262 22438 catalog_manager.cc:4841] TS e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521): tablet 5e7acb407db14fbcba9cd099461e7d08 (table test-table [id=377b886f78e3404885525238213bf776]) successfully deleted
I20260808 05:03:42.332337 22438 catalog_manager.cc:4841] TS 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195:40729): tablet 5e7acb407db14fbcba9cd099461e7d08 (table test-table [id=377b886f78e3404885525238213bf776]) successfully deleted
I20260808 05:03:42.332376 22439 catalog_manager.cc:4841] TS 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567): tablet 5e7acb407db14fbcba9cd099461e7d08 (table test-table [id=377b886f78e3404885525238213bf776]) successfully deleted
I20260808 05:03:42.333195 23111 tablet_service.cc:1467] Processing CreateTablet for tablet c3b6293426f24606846a2fb8211282df (DEFAULT_TABLE table=test-table [id=32945679788943cb80a1d13115df28cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:42.333336 23111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3b6293426f24606846a2fb8211282df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:42.334131 23256 tablet_bootstrap.cc:492] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: Bootstrap starting.
I20260808 05:03:42.334190 22877 tablet_service.cc:1467] Processing CreateTablet for tablet c3b6293426f24606846a2fb8211282df (DEFAULT_TABLE table=test-table [id=32945679788943cb80a1d13115df28cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:42.334314 22877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3b6293426f24606846a2fb8211282df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:42.334496 23256 tablet_bootstrap.cc:654] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:42.335067 23256 tablet_bootstrap.cc:492] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: No bootstrap required, opened a new log
I20260808 05:03:42.335131 23256 ts_tablet_manager.cc:1397] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:42.335255 23256 raft_consensus.cc:348] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.335346 23256 raft_consensus.cc:374] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:42.335340 23257 tablet_bootstrap.cc:492] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: Bootstrap starting.
I20260808 05:03:42.335369 23256 raft_consensus.cc:729] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0b01c5c06167457e86f654d6e0f78868, State: Initialized, Role: FOLLOWER
I20260808 05:03:42.335409 23256 consensus_queue.cc:260] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.335505 23256 ts_tablet_manager.cc:1428] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:42.335497 22667 tablet_service.cc:1467] Processing CreateTablet for tablet c3b6293426f24606846a2fb8211282df (DEFAULT_TABLE table=test-table [id=32945679788943cb80a1d13115df28cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:03:42.335625 22667 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3b6293426f24606846a2fb8211282df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:42.335625 23257 tablet_bootstrap.cc:654] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:42.336140 23257 tablet_bootstrap.cc:492] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: No bootstrap required, opened a new log
I20260808 05:03:42.336210 23257 ts_tablet_manager.cc:1397] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:42.336316 23257 raft_consensus.cc:348] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.336402 23257 raft_consensus.cc:374] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:42.336431 23257 raft_consensus.cc:729] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3707e6b13c047a59c1d8d97cc7528bf, State: Initialized, Role: FOLLOWER
I20260808 05:03:42.336475 23257 consensus_queue.cc:260] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.336568 23257 ts_tablet_manager.cc:1428] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:42.336998 23260 tablet_bootstrap.cc:492] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757: Bootstrap starting.
I20260808 05:03:42.337309 23260 tablet_bootstrap.cc:654] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:42.337821 23260 tablet_bootstrap.cc:492] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757: No bootstrap required, opened a new log
I20260808 05:03:42.337858 23260 ts_tablet_manager.cc:1397] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:42.337988 23260 raft_consensus.cc:348] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.338050 23260 raft_consensus.cc:374] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:42.338093 23260 raft_consensus.cc:729] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ad7b154c342430b8828e066577b7757, State: Initialized, Role: FOLLOWER
I20260808 05:03:42.338145 23260 consensus_queue.cc:260] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.338272 23260 ts_tablet_manager.cc:1428] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
W20260808 05:03:42.443547 23212 tablet.cc:2369] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:03:42.473486 23334 raft_consensus.cc:482] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:03:42.473672 23334 raft_consensus.cc:504] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.473901 23334 leader_election.cc:288] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567), e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521)
I20260808 05:03:42.474164 22697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3b6293426f24606846a2fb8211282df" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad7b154c342430b8828e066577b7757" is_pre_election: true
I20260808 05:03:42.474162 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3b6293426f24606846a2fb8211282df" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" is_pre_election: true
I20260808 05:03:42.474283 22697 raft_consensus.cc:2454] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 0.
I20260808 05:03:42.474279 22907 raft_consensus.cc:2454] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 0.
I20260808 05:03:42.474519 23033 leader_election.cc:302] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b01c5c06167457e86f654d6e0f78868, e3707e6b13c047a59c1d8d97cc7528bf; no voters:
I20260808 05:03:42.474691 23334 raft_consensus.cc:2781] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:03:42.474754 23334 raft_consensus.cc:482] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:03:42.474782 23334 raft_consensus.cc:3037] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.475579 23334 raft_consensus.cc:504] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.475747 23334 leader_election.cc:288] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 election: Requested vote from peers 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567), e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521)
I20260808 05:03:42.475895 22697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3b6293426f24606846a2fb8211282df" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ad7b154c342430b8828e066577b7757"
I20260808 05:03:42.475924 22907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3b6293426f24606846a2fb8211282df" candidate_uuid: "0b01c5c06167457e86f654d6e0f78868" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3707e6b13c047a59c1d8d97cc7528bf"
I20260808 05:03:42.475987 22697 raft_consensus.cc:3037] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.476011 22907 raft_consensus.cc:3037] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:42.476835 22697 raft_consensus.cc:2454] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 1.
I20260808 05:03:42.476867 22907 raft_consensus.cc:2454] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0b01c5c06167457e86f654d6e0f78868 in term 1.
I20260808 05:03:42.477023 23033 leader_election.cc:302] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0b01c5c06167457e86f654d6e0f78868, e3707e6b13c047a59c1d8d97cc7528bf; no voters:
I20260808 05:03:42.477139 23334 raft_consensus.cc:2781] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:42.477211 23334 raft_consensus.cc:686] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 1 LEADER]: Becoming Leader. State: Replica: 0b01c5c06167457e86f654d6e0f78868, State: Running, Role: LEADER
I20260808 05:03:42.477298 23334 consensus_queue.cc:237] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } }
I20260808 05:03:42.477873 22463 catalog_manager.cc:5495] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "0b01c5c06167457e86f654d6e0f78868" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0b01c5c06167457e86f654d6e0f78868" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40729 } health_report { overall_health: HEALTHY } } }
I20260808 05:03:42.519066 22907 raft_consensus.cc:1261] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Refusing update from remote peer 0b01c5c06167457e86f654d6e0f78868: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:42.519065 22697 raft_consensus.cc:1261] T c3b6293426f24606846a2fb8211282df P 0ad7b154c342430b8828e066577b7757 [term 1 FOLLOWER]: Refusing update from remote peer 0b01c5c06167457e86f654d6e0f78868: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:03:42.519356 23263 consensus_queue.cc:1035] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ad7b154c342430b8828e066577b7757" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44567 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:42.519474 23334 consensus_queue.cc:1035] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3707e6b13c047a59c1d8d97cc7528bf" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:03:42.529107 22463 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:42.529239 22463 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54542:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:03:42.529858 22463 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d1e9907c3c4a49cba498c6f834569e2d: Sending DeleteTablet for 3 replicas of tablet c3b6293426f24606846a2fb8211282df
I20260808 05:03:42.530319 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 22567
I20260808 05:03:42.536285 23111 tablet_service.cc:1514] Processing DeleteTablet for tablet c3b6293426f24606846a2fb8211282df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:42 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:54556
I20260808 05:03:42.536404 23297 tablet_replica.cc:330] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: stopping tablet replica
I20260808 05:03:42.536402 22877 tablet_service.cc:1514] Processing DeleteTablet for tablet c3b6293426f24606846a2fb8211282df with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:03:42 UTC) from {username='oryx', principal='oryx/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:41412
I20260808 05:03:42.536465 23297 raft_consensus.cc:2229] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:03:42.536475 23298 tablet_replica.cc:330] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: stopping tablet replica
I20260808 05:03:42.536520 23298 raft_consensus.cc:2229] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:03:42.536527 23297 raft_consensus.cc:2258] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:42.536562 23298 raft_consensus.cc:2258] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:03:42.536868 23297 ts_tablet_manager.cc:1905] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:42.538441 23297 ts_tablet_manager.cc:1918] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:42.538533 23297 log.cc:1196] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/c3b6293426f24606846a2fb8211282df
I20260808 05:03:42.538785 23297 ts_tablet_manager.cc:1939] T c3b6293426f24606846a2fb8211282df P 0b01c5c06167457e86f654d6e0f78868: Deleting consensus metadata
I20260808 05:03:42.538961 23298 ts_tablet_manager.cc:1905] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:03:42.539134 22438 catalog_manager.cc:4841] TS 0b01c5c06167457e86f654d6e0f78868 (127.11.70.195:40729): tablet c3b6293426f24606846a2fb8211282df (table test-table [id=32945679788943cb80a1d13115df28cd]) successfully deleted
I20260808 05:03:42.540197 23298 ts_tablet_manager.cc:1918] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:03:42.540292 23298 log.cc:1196] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/c3b6293426f24606846a2fb8211282df
I20260808 05:03:42.540496 23298 ts_tablet_manager.cc:1939] T c3b6293426f24606846a2fb8211282df P e3707e6b13c047a59c1d8d97cc7528bf: Deleting consensus metadata
I20260808 05:03:42.540836 22438 catalog_manager.cc:4841] TS e3707e6b13c047a59c1d8d97cc7528bf (127.11.70.194:43521): tablet c3b6293426f24606846a2fb8211282df (table test-table [id=32945679788943cb80a1d13115df28cd]) successfully deleted
W20260808 05:03:42.543120 22439 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:44567 (error 108)
I20260808 05:03:42.543371 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 22775
I20260808 05:03:42.553478 23388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:42.553283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:44567 (local address 127.0.0.1:32904)
0808 05:03:42.553391 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:42.553435 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:44567: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":57,"threads_started":1}
W20260808 05:03:42.553643 22439 catalog_manager.cc:4584] TS 0ad7b154c342430b8828e066577b7757 (127.11.70.193:44567): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c3b6293426f24606846a2fb8211282df: Network error: Client connection negotiation failed: client connection to 127.11.70.193:44567: connect: Connection refused (error 111)
I20260808 05:03:42.558983 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 23003
I20260808 05:03:42.571374 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 22413
2026-08-08T05:03:42Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2924 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:42 dist-test-slave-7kzw krb5kdc[23395](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:42 dist-test-slave-7kzw krb5kdc[23395](info): set up 2 sockets
Aug 08 05:03:42 dist-test-slave-7kzw krb5kdc[23395](info): commencing operation
krb5kdc: starting...
W20260808 05:03:43.816265 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.217s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:43 dist-test-slave-7kzw krb5kdc[23395](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165423, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:43.941373 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43437
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:33417
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:43437
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:44.023891 23412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:44.024101 23412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:44.024122 23412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:44.025190 23412 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:44.025223 23412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:44.025238 23412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:44.025250 23412 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:44.025262 23412 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:44.026675 23412 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:33417
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:43437
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43437
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:44.026870 23412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:44.027045 23412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:44.032045 23423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:44.032063 23412 server_base.cc:1034] running on GCE node
W20260808 05:03:44.032029 23419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:44.032018 23418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:44.032542 23412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:44.032831 23412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:44.034003 23412 hybrid_clock.cc:648] HybridClock initialized: now 1786165424033993 us; error 33 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T05:03:44Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1470 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:03:44 dist-test-slave-7kzw krb5kdc[23432](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:03:44 dist-test-slave-7kzw krb5kdc[23432](info): set up 2 sockets
Aug 08 05:03:44 dist-test-slave-7kzw krb5kdc[23432](info): commencing operation
krb5kdc: starting...
W20260808 05:03:45.275956 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.206s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:03:45 dist-test-slave-7kzw krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:03:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:03:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:03:45.398932 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37183
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:37183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:45.480537 23451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:45.480756 23451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:45.480778 23451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:45.481938 23451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:45.481980 23451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:45.481995 23451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:45.482054 23451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:45.482082 23451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:45.483593 23451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:37183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:45.483850 23451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:45.484089 23451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:45.489384 23458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:45.489384 23459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:45.489590 23462 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:45.489740 23451 server_base.cc:1034] running on GCE node
I20260808 05:03:45.490020 23451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:45.490340 23451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:45.491533 23451 hybrid_clock.cc:648] HybridClock initialized: now 1786165425491579 us; error 104 us; skew 500 ppm
Aug 08 05:03:45 dist-test-slave-7kzw krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165425, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:45.494266 23451 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:45.494807 23451 webserver.cc:460] Webserver started at http://127.11.70.254:35071/ using document root <none> and password file <none>
I20260808 05:03:45.495080 23451 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:45.495154 23451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:45.495308 23451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:45.496387 23451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "0f992a40f6ad4550b11a85036173cfd1"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "1d90d7e731832301bb44f48ae3308418"
server_key_iv: "16d7dcc0a649899d069e0533b3fee014"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.496762 23451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "0f992a40f6ad4550b11a85036173cfd1"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "1d90d7e731832301bb44f48ae3308418"
server_key_iv: "16d7dcc0a649899d069e0533b3fee014"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.498157 23451 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:03:45.499079 23474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:45.499295 23451 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:45.499418 23451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "0f992a40f6ad4550b11a85036173cfd1"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "1d90d7e731832301bb44f48ae3308418"
server_key_iv: "16d7dcc0a649899d069e0533b3fee014"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.499497 23451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:45.510222 23451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:45.512640 23451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:45.512813 23451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:45.517253 23451 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:37183
I20260808 05:03:45.517285 23562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:37183 every 8 connection(s)
I20260808 05:03:45.517645 23451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:45.518582 23563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:03:45.520905 23563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: Bootstrap starting.
I20260808 05:03:45.521430 23563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: Neither blocks nor log segments found. Creating new log.
I20260808 05:03:45.521683 23563 log.cc:824] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:45.522342 23563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: No bootstrap required, opened a new log
I20260808 05:03:45.523886 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 23451
I20260808 05:03:45.524060 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:03:45.523996 23563 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } }
I20260808 05:03:45.524227 23563 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:03:45.524281 23563 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f992a40f6ad4550b11a85036173cfd1, State: Initialized, Role: FOLLOWER
I20260808 05:03:45.524290 11547 external_mini_cluster.cc:1428] Setting key 37bafdcd1ba9092b916edea0c91aae32
I20260808 05:03:45.524425 23563 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } }
I20260808 05:03:45.524525 23563 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:45.524565 23563 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:45.524613 23563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:03:45.525712 23563 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } }
I20260808 05:03:45.525837 23563 leader_election.cc:302] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f992a40f6ad4550b11a85036173cfd1; no voters:
I20260808 05:03:45.526016 23563 leader_election.cc:288] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:03:45.526057 23572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:03:45.526255 23572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 1 LEADER]: Becoming Leader. State: Replica: 0f992a40f6ad4550b11a85036173cfd1, State: Running, Role: LEADER
I20260808 05:03:45.526293 23563 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:45.526357 23572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } }
I20260808 05:03:45.526734 23572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f992a40f6ad4550b11a85036173cfd1. Latest consensus state: current_term: 1 leader_uuid: "0f992a40f6ad4550b11a85036173cfd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } } }
I20260808 05:03:45.526834 23572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:45.527034 23581 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:45.527532 23581 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:45.528370 23573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f992a40f6ad4550b11a85036173cfd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } } }
I20260808 05:03:45.528475 23573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:45.529124 23581 catalog_manager.cc:1347] Generated new cluster ID: 9ec170d8c3db417798dc905a6d81052c
I20260808 05:03:45.529183 23581 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:03:45 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165425, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:45.535506 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:45.525003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40670 (local address 127.11.70.254:37183)
0808 05:03:45.525276 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:45.525288 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:45.525330 (+ 42us) server_negotiation.cc:407] Connection header received
0808 05:03:45.525461 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:45.525468 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:45.525523 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:45.525672 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:45.526519 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.528088 (+ 1569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.529124 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.529621 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.529750 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:45.532162 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:45.532165 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:45.532166 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:45.532178 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:45.533930 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:45.534310 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:45.534313 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:45.534314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:45.534422 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:45.534674 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:45.534675 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:45.534675 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:45.534913 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:45.535114 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:45.535182 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 05:03:45.535323 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":137,"threads_started":1}
I20260808 05:03:45.537284 23581 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:03:45.537775 23581 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:45.544668 23581 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: Generated new TSK 0
I20260808 05:03:45.544853 23581 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:03:45.577394 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37183
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:45.670230 23599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:45.670424 23599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:45.670447 23599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:45.671649 23599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:45.671692 23599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:45.671722 23599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:45.673151 23599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:45.673383 23599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:45.673647 23599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:45.679515 23609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:45.679646 23613 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:45.679499 23608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:45.679843 23599 server_base.cc:1034] running on GCE node
I20260808 05:03:45.680032 23599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:45.680299 23599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:45.681471 23599 hybrid_clock.cc:648] HybridClock initialized: now 1786165425681458 us; error 31 us; skew 500 ppm
Aug 08 05:03:45 dist-test-slave-7kzw krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165425, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:45.684087 23599 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:03:45.684526 23599 webserver.cc:460] Webserver started at http://127.11.70.193:33361/ using document root <none> and password file <none>
I20260808 05:03:45.684791 23599 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:45.684865 23599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:45.685017 23599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:45.686110 23599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "8005ab0f0c1a436ab938d046007b9f72"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "53aab14a2793677ea6924a129e14a3c1"
server_key_iv: "b7ed1bd74351365ecc910e3376faeb22"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.686524 23599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "8005ab0f0c1a436ab938d046007b9f72"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "53aab14a2793677ea6924a129e14a3c1"
server_key_iv: "b7ed1bd74351365ecc910e3376faeb22"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.687966 23599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:45.688712 23621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:45.688895 23599 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:45.689002 23599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "8005ab0f0c1a436ab938d046007b9f72"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "53aab14a2793677ea6924a129e14a3c1"
server_key_iv: "b7ed1bd74351365ecc910e3376faeb22"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.689078 23599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:45.702502 23599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:45.704375 23599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:45.704541 23599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:45.704789 23599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:45.705107 23599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:45.705163 23599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:45.705199 23599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:45.705227 23599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:45.711196 23599 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:38111
I20260808 05:03:45.711277 23785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:38111 every 8 connection(s)
I20260808 05:03:45.711577 23599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:03:45.713351 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 23599
I20260808 05:03:45.713440 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:03:45.713644 11547 external_mini_cluster.cc:1428] Setting key 79809b600db94d548cb86038b43e89eb
Aug 08 05:03:45 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165425, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:45.721726 23788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:45.712322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:35565)
0808 05:03:45.712519 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:45.712555 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:45.713017 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:45.713211 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:45.713215 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:45.713884 (+ 669us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:45.714076 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:45.714080 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.714924 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.714925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:45.715732 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:45.715734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.716265 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.716266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:45.716374 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:45.716836 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:45.716844 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:45.718441 (+ 1597us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:45.720376 (+ 1935us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:45.720383 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:45.720385 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:45.720626 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:45.720862 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:45.720863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:45.720863 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:45.720963 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:45.721264 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:45.721269 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:45.721378 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 05:03:45.721453 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:03:45.721569 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":115,"threads_started":1}
I20260808 05:03:45.721714 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:45.712335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:35565 (local address 127.11.70.254:37183)
0808 05:03:45.712418 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:45.712421 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:45.712639 (+ 218us) server_negotiation.cc:407] Connection header received
0808 05:03:45.713100 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:45.713101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:45.713111 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:45.713163 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:45.714174 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.714820 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.715834 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.716167 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.716246 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:45.718550 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:45.718552 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:45.718552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:45.718561 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:45.720280 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:45.720707 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:45.720708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:45.720709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:45.720789 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:45.721030 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:45.721031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:45.721031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:45.721189 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:45.721263 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:45.721505 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 05:03:45.721598 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:03:45.722271 23786 heartbeater.cc:347] Connected to a master server at 127.11.70.254:37183
I20260808 05:03:45.722388 23786 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:45.722637 23786 heartbeater.cc:511] Master 127.11.70.254:37183 requested a full tablet report, sending...
I20260808 05:03:45.723208 23501 ts_manager.cc:194] Registered new tserver with Master: 8005ab0f0c1a436ab938d046007b9f72 (127.11.70.193:38111)
I20260808 05:03:45.723834 23501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:35565
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:03:45.741252 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37183
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:45.824530 23797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:45.824744 23797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:45.824769 23797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:45.825973 23797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:45.826013 23797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:45.826040 23797 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:45.827684 23797 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:45.827929 23797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:45.828157 23797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:45.833086 23805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:45.833086 23808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:45.833146 23804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:45.833333 23797 server_base.cc:1034] running on GCE node
I20260808 05:03:45.833572 23797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:45.833820 23797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:45.834980 23797 hybrid_clock.cc:648] HybridClock initialized: now 1786165425834965 us; error 27 us; skew 500 ppm
Aug 08 05:03:45 dist-test-slave-7kzw krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165425, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:45.837383 23797 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:03:45.837834 23797 webserver.cc:460] Webserver started at http://127.11.70.194:45633/ using document root <none> and password file <none>
I20260808 05:03:45.838028 23797 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:45.838069 23797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:45.838158 23797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:45.839234 23797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "c4501d065cfe441aa848f3d160ba971e"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "85abad43e3f1a215ffa2ac7b32819007"
server_key_iv: "3f4e58e6ec2d97f4cfc49e309fb38b11"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.839542 23797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "c4501d065cfe441aa848f3d160ba971e"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "85abad43e3f1a215ffa2ac7b32819007"
server_key_iv: "3f4e58e6ec2d97f4cfc49e309fb38b11"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.840808 23797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:03:45.841491 23821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:45.841681 23797 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:03:45.841778 23797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "c4501d065cfe441aa848f3d160ba971e"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "85abad43e3f1a215ffa2ac7b32819007"
server_key_iv: "3f4e58e6ec2d97f4cfc49e309fb38b11"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.841835 23797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:45.855890 23797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:45.857613 23797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:45.857722 23797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:45.857898 23797 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:45.858139 23797 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:45.858177 23797 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:45.858201 23797 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:45.858212 23797 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:45.864162 23797 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:42311
I20260808 05:03:45.864236 23992 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:42311 every 8 connection(s)
I20260808 05:03:45.864547 23797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:45.866509 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 23797
I20260808 05:03:45.866636 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:03:45.866842 11547 external_mini_cluster.cc:1428] Setting key af818769c9db883fd588865118abba2d
Aug 08 05:03:45 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165425, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:45.874861 23997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:45.865263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:43807)
0808 05:03:45.865444 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:45.865488 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:45.866004 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:45.866248 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:45.866252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:45.866979 (+ 727us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:45.867288 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:45.867294 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.868205 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.868205 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:45.869159 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:45.869162 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.869599 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.869600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:45.869706 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:45.870249 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:45.870257 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:45.871852 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:45.873451 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:45.873458 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:45.873460 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:45.873681 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:45.873916 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:45.873916 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:45.873917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:45.874022 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:45.874336 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:45.874340 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:45.874447 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 05:03:45.874584 (+ 137us) client_negotiation.cc:240] Negotiation successful
0808 05:03:45.874703 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":84,"threads_started":1}
I20260808 05:03:45.874868 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:45.865305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:43807 (local address 127.11.70.254:37183)
0808 05:03:45.865394 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:45.865397 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:45.865573 (+ 176us) server_negotiation.cc:407] Connection header received
0808 05:03:45.866114 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:45.866116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:45.866129 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:45.866183 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:45.867378 (+ 1195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.868099 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.869267 (+ 1168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:45.869490 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:45.869525 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:45.871950 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:45.871952 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:45.871952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:45.871962 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:45.873379 (+ 1417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:45.873764 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:45.873765 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:45.873766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:45.873839 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:45.874092 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:45.874093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:45.874093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:45.874261 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:45.874344 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:45.874621 (+ 277us) server_negotiation.cc:299] Negotiation successful
0808 05:03:45.874724 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:03:45.875560 23993 heartbeater.cc:347] Connected to a master server at 127.11.70.254:37183
I20260808 05:03:45.875670 23993 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:45.875867 23993 heartbeater.cc:511] Master 127.11.70.254:37183 requested a full tablet report, sending...
I20260808 05:03:45.876272 23501 ts_manager.cc:194] Registered new tserver with Master: c4501d065cfe441aa848f3d160ba971e (127.11.70.194:42311)
I20260808 05:03:45.876643 23501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:43807
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:03:45.897843 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37183
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:45.981216 24000 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:45.981431 24000 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:45.981453 24000 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:45.982630 24000 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:45.982674 24000 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:45.982702 24000 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:45.984200 24000 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24000
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:45.984449 24000 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:45.984696 24000 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:45.990077 24011 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:45.990113 24007 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:45.990124 24008 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:45.990532 24000 server_base.cc:1034] running on GCE node
I20260808 05:03:45.990717 24000 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:45.990957 24000 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:45.992093 24000 hybrid_clock.cc:648] HybridClock initialized: now 1786165425992085 us; error 35 us; skew 500 ppm
Aug 08 05:03:45 dist-test-slave-7kzw krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165425, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:45.994737 24000 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:03:45.995139 24000 webserver.cc:460] Webserver started at http://127.11.70.195:45391/ using document root <none> and password file <none>
I20260808 05:03:45.995322 24000 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:45.995363 24000 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:45.995450 24000 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:03:45.996466 24000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "9aa39c4f1db74c3bacc86f5b364bb909"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "47dbbbfa04ca5b695a7e3d81cba472ff"
server_key_iv: "c127dd84ad3830737d2ac10483191cd6"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.996778 24000 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "9aa39c4f1db74c3bacc86f5b364bb909"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "47dbbbfa04ca5b695a7e3d81cba472ff"
server_key_iv: "c127dd84ad3830737d2ac10483191cd6"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.998127 24000 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:03:45.998905 24025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:45.999130 24000 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:45.999238 24000 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "9aa39c4f1db74c3bacc86f5b364bb909"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "47dbbbfa04ca5b695a7e3d81cba472ff"
server_key_iv: "c127dd84ad3830737d2ac10483191cd6"
server_key_version: "encryptionkey@0"
I20260808 05:03:45.999328 24000 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:46.021436 24000 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:46.023698 24000 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:46.023869 24000 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:46.024132 24000 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:46.024482 24000 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:46.024540 24000 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.024613 24000 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:46.024646 24000 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.031422 24000 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:33437
I20260808 05:03:46.031467 24189 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:33437 every 8 connection(s)
I20260808 05:03:46.031797 24000 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:03:46.033435 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 24000
I20260808 05:03:46.033576 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:03:46.033830 11547 external_mini_cluster.cc:1428] Setting key 6df191d02ee07143705417abe18e58d5
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165425, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:03:46.041375 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.032529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:56445 (local address 127.11.70.254:37183)
0808 05:03:46.032576 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.032579 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.032791 (+ 212us) server_negotiation.cc:407] Connection header received
0808 05:03:46.033287 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.033288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.033297 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.033342 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.034737 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.035314 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.036303 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.036486 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.036547 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.038754 (+ 2207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:46.038756 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:46.038756 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:46.038763 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:46.040031 (+ 1268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:46.040478 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:46.040479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:46.040479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:46.040532 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:46.040778 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:46.040778 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:46.040778 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:46.040876 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:46.040930 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:46.041241 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 05:03:46.041308 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:03:46.041551 24195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.032491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:56445)
0808 05:03:46.032658 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.032700 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.033178 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.033436 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.033440 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.034315 (+ 875us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.034639 (+ 324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.034653 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.035399 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.035400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.036224 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.036226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.036602 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.036603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.036704 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.037154 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.037162 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.038672 (+ 1510us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:03:46.040123 (+ 1451us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:46.040131 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:46.040133 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:46.040404 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:46.040597 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:03:46.040597 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:03:46.040598 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:03:46.040720 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:03:46.040961 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:03:46.040967 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:03:46.041107 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 05:03:46.041207 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 05:03:46.041338 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
I20260808 05:03:46.042132 24192 heartbeater.cc:347] Connected to a master server at 127.11.70.254:37183
I20260808 05:03:46.042236 24192 heartbeater.cc:464] Registering TS with master...
I20260808 05:03:46.042450 24192 heartbeater.cc:511] Master 127.11.70.254:37183 requested a full tablet report, sending...
I20260808 05:03:46.042908 23501 ts_manager.cc:194] Registered new tserver with Master: 9aa39c4f1db74c3bacc86f5b364bb909 (127.11.70.195:33437)
I20260808 05:03:46.043285 23501 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:56445
I20260808 05:03:46.045871 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab.
Entry for principal oryx/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab.
WARNING: no policy specified for oryx/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab.
Entry for principal oryx/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab.
WARNING: no policy specified for oryx/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab.
Entry for principal oryx/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab.
I20260808 05:03:46.121476 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 23599
I20260808 05:03:46.139119 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 23797
I20260808 05:03:46.149596 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 24000
I20260808 05:03:46.155551 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 23451
I20260808 05:03:46.164180 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37183
--webserver_interface=127.11.70.254
--webserver_port=35071
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:37183
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:03:46.247808 24210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:46.248073 24210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:46.248114 24210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:46.249346 24210 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:03:46.249424 24210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:46.249449 24210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:46.249470 24210 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:03:46.249500 24210 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:03:46.251024 24210 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:37183
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37183
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=35071
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:46.251323 24210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:46.251573 24210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:46.256639 24221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:46.256647 24216 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:46.256647 24218 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:46.257004 24210 server_base.cc:1034] running on GCE node
I20260808 05:03:46.257340 24210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:46.257674 24210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:46.258853 24210 hybrid_clock.cc:648] HybridClock initialized: now 1786165426258838 us; error 46 us; skew 500 ppm
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165426, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:46.261749 24210 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:03:46.262238 24210 webserver.cc:460] Webserver started at http://127.11.70.254:35071/ using document root <none> and password file <none>
I20260808 05:03:46.262570 24210 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:46.262668 24210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:46.264181 24210 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:46.264979 24232 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.265161 24210 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:03:46.265277 24210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "0f992a40f6ad4550b11a85036173cfd1"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "1d90d7e731832301bb44f48ae3308418"
server_key_iv: "16d7dcc0a649899d069e0533b3fee014"
server_key_version: "encryptionkey@0"
I20260808 05:03:46.265720 24210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:46.296568 24210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:46.299232 24210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:46.299364 24210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:46.303941 24210 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:37183
I20260808 05:03:46.304008 24316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:37183 every 8 connection(s)
I20260808 05:03:46.304563 24210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:03:46.305907 24317 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:03:46.306718 24317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: Bootstrap starting.
I20260808 05:03:46.309839 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 24210
I20260808 05:03:46.310176 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:38111
--local_ip_for_outbound_sockets=127.11.70.193
--tserver_master_addrs=127.11.70.254:37183
--webserver_port=33361
--webserver_interface=127.11.70.193
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.70.193
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:03:46.317387 24317 log.cc:824] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:03:46.319806 24317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:03:46.320199 24317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: Bootstrap complete.
I20260808 05:03:46.324385 24317 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } }
I20260808 05:03:46.324700 24317 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f992a40f6ad4550b11a85036173cfd1, State: Initialized, Role: FOLLOWER
I20260808 05:03:46.324863 24317 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } }
I20260808 05:03:46.324934 24317 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:03:46.324971 24317 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:03:46.325019 24317 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:03:46.326311 24317 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } }
I20260808 05:03:46.326429 24317 leader_election.cc:302] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f992a40f6ad4550b11a85036173cfd1; no voters:
I20260808 05:03:46.326629 24317 leader_election.cc:288] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:03:46.326753 24323 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:03:46.326881 24317 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:03:46.326962 24323 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [term 2 LEADER]: Becoming Leader. State: Replica: 0f992a40f6ad4550b11a85036173cfd1, State: Running, Role: LEADER
I20260808 05:03:46.327068 24323 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } }
I20260808 05:03:46.327436 24325 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "0f992a40f6ad4550b11a85036173cfd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } } }
I20260808 05:03:46.327514 24325 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:46.327759 24326 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f992a40f6ad4550b11a85036173cfd1. Latest consensus state: current_term: 2 leader_uuid: "0f992a40f6ad4550b11a85036173cfd1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f992a40f6ad4550b11a85036173cfd1" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37183 } } }
I20260808 05:03:46.327898 24326 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1 [sys.catalog]: This master's current role is: LEADER
I20260808 05:03:46.327987 24337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:03:46.328653 24337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:03:46.328801 24337 catalog_manager.cc:1259] Loaded cluster ID: 9ec170d8c3db417798dc905a6d81052c
I20260808 05:03:46.328840 24337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:03:46.329970 24337 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:03:46.330159 24337 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 0f992a40f6ad4550b11a85036173cfd1: Loaded TSK: 0
I20260808 05:03:46.330376 24337 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:03:46.400645 24320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:46.400882 24320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:46.400919 24320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:46.402070 24320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:46.402143 24320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:46.402189 24320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:03:46.403681 24320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.193.keytab
--principal=oryx/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:38111
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=33361
--tserver_master_addrs=127.11.70.254:37183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:46.403942 24320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:46.404179 24320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:46.410322 24356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:46.410305 24353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:46.410295 24354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:46.410660 24320 server_base.cc:1034] running on GCE node
I20260808 05:03:46.410950 24320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:46.411237 24320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:46.412408 24320 hybrid_clock.cc:648] HybridClock initialized: now 1786165426412394 us; error 30 us; skew 500 ppm
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165426, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:46.415021 24320 init.cc:377] Logged in from keytab as oryx/127.11.70.193@KRBTEST.COM (short username oryx)
I20260808 05:03:46.415537 24320 webserver.cc:460] Webserver started at http://127.11.70.193:33361/ using document root <none> and password file <none>
I20260808 05:03:46.415778 24320 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:46.415838 24320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:46.417308 24320 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 05:03:46.417974 24364 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.418181 24320 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:03:46.418289 24320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "8005ab0f0c1a436ab938d046007b9f72"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "53aab14a2793677ea6924a129e14a3c1"
server_key_iv: "b7ed1bd74351365ecc910e3376faeb22"
server_key_version: "encryptionkey@0"
I20260808 05:03:46.418783 24320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:46.436647 24320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:46.439273 24320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:46.439452 24320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:46.439728 24320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:46.440094 24320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:46.440145 24320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.440176 24320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:46.440204 24320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.447628 24320 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:38111
I20260808 05:03:46.447686 24540 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:38111 every 8 connection(s)
I20260808 05:03:46.448062 24320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:46.457315 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.448800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:54885)
0808 05:03:46.448989 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.449038 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.449521 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.449978 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.449981 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.450626 (+ 645us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.450823 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.450829 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.452483 (+ 1654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.452484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.453269 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.453271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.454028 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.454029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.454126 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.454698 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.454707 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.457154 (+ 2447us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":86,"threads_started":1}
W20260808 05:03:46.457489 24544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:46.448881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:54885 (local address 127.11.70.254:37183)
0808 05:03:46.449104 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.449113 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.449157 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:03:46.449732 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.449739 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.449793 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.449930 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.450944 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.452383 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.453357 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.453932 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.454043 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.457322 (+ 3279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:54885: BlockingRecv error: recv got EOF from 127.11.70.193:54885 (error 108)
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":118,"threads_started":1}
I20260808 05:03:46.457577 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 24320
W20260808 05:03:46.457675 24541 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:37183 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.70.254:37183: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
I20260808 05:03:46.457944 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:42311
--local_ip_for_outbound_sockets=127.11.70.194
--tserver_master_addrs=127.11.70.254:37183
--webserver_port=45633
--webserver_interface=127.11.70.194
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.70.194
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:46.463770 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.457921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:40085)
0808 05:03:46.458387 (+ 466us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.458400 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.458457 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.458620 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.458621 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.458782 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.458838 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.458840 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.459739 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.459740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.460563 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.460566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.461031 (+ 465us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.461032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.461107 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.461555 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.461561 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.463708 (+ 2147us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":446}
W20260808 05:03:46.463915 24544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:46.458011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:40085 (local address 127.11.70.254:37183)
0808 05:03:46.458045 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.458047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.458457 (+ 410us) server_negotiation.cc:407] Connection header received
0808 05:03:46.458533 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.458534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.458547 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.458600 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.458912 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.459645 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.460656 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.460956 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.461017 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.463831 (+ 2814us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:40085: BlockingRecv error: recv got EOF from 127.11.70.193:40085 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:46.469269 24543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.464365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:45087)
0808 05:03:46.464414 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.464424 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.464461 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.464605 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.464606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.464762 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.464798 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.464801 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.465622 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.465623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.466565 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.466567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.466905 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.466906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.466971 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.467360 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.467366 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.469177 (+ 1811us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 05:03:46.469414 24541 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:03:46.469448 24544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:46.464426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:45087 (local address 127.11.70.254:37183)
0808 05:03:46.464467 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.464469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.464480 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:46.464517 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.464518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.464527 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.464577 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.464881 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.465529 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.466647 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.466821 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.466879 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.469306 (+ 2427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:45087: BlockingRecv error: recv got EOF from 127.11.70.193:45087 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 05:03:46.544371 24545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:46.544569 24545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:46.544592 24545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:46.545679 24545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:46.545717 24545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:46.545748 24545 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:03:46.547160 24545 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.194.keytab
--principal=oryx/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:42311
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=45633
--tserver_master_addrs=127.11.70.254:37183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:46.547365 24545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:46.547547 24545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:46.552840 24552 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:46.552994 24556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:46.553036 24545 server_base.cc:1034] running on GCE node
W20260808 05:03:46.553004 24553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:46.553344 24545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:46.553601 24545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:46.554765 24545 hybrid_clock.cc:648] HybridClock initialized: now 1786165426554736 us; error 59 us; skew 500 ppm
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165426, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:46.557345 24545 init.cc:377] Logged in from keytab as oryx/127.11.70.194@KRBTEST.COM (short username oryx)
I20260808 05:03:46.557773 24545 webserver.cc:460] Webserver started at http://127.11.70.194:45633/ using document root <none> and password file <none>
I20260808 05:03:46.558023 24545 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:46.558107 24545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:46.559542 24545 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:46.560143 24566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.560333 24545 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:03:46.560431 24545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "c4501d065cfe441aa848f3d160ba971e"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "85abad43e3f1a215ffa2ac7b32819007"
server_key_iv: "3f4e58e6ec2d97f4cfc49e309fb38b11"
server_key_version: "encryptionkey@0"
I20260808 05:03:46.560778 24545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:46.579596 24545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:46.582007 24545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:46.582185 24545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:46.582443 24545 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:46.582830 24545 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:46.582865 24545 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.582911 24545 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:46.582937 24545 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.588858 24545 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:42311
I20260808 05:03:46.588907 24745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:42311 every 8 connection(s)
I20260808 05:03:46.589303 24545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:03:46.594621 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 24545
I20260808 05:03:46.594928 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:33437
--local_ip_for_outbound_sockets=127.11.70.195
--tserver_master_addrs=127.11.70.254:37183
--webserver_port=45391
--webserver_interface=127.11.70.195
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37439
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.11.70.195
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:03:46.596698 24544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:46.590096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:42459 (local address 127.11.70.254:37183)
0808 05:03:46.590168 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.590170 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.590394 (+ 224us) server_negotiation.cc:407] Connection header received
0808 05:03:46.590940 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.590940 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.590953 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.591017 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.591928 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.592411 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.593348 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.593532 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.593585 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.596614 (+ 3029us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:42459: BlockingRecv error: recv got EOF from 127.11.70.194:42459 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:03:46.596717 24750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.590084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:42459)
0808 05:03:46.590256 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.590299 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.590845 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.591067 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.591071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.591642 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.591833 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.591838 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.592493 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.592494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.593268 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.593269 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.593607 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.593608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.593705 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.594246 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.594254 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.596484 (+ 2230us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":99,"threads_started":1}
W20260808 05:03:46.596947 24746 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:37183 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.70.254:37183: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:46.601508 24750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.597204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:44819)
0808 05:03:46.597249 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.597260 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.597298 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.597443 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.597444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.597574 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.597615 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.597616 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.598230 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.598231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.598815 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.598817 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.599171 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.599172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.599250 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.599703 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.599708 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.601410 (+ 1702us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 05:03:46.601531 24544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:46.597251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:44819 (local address 127.11.70.254:37183)
0808 05:03:46.597302 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.597304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.597330 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:03:46.597352 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.597352 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.597363 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.597422 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.597703 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.598140 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.598901 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.599086 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.599178 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.601489 (+ 2311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:44819: BlockingRecv error: recv got EOF from 127.11.70.194:44819 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:46.606613 24750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.602003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:55765)
0808 05:03:46.602062 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.602073 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.602117 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.602273 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.602274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.602379 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.602406 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.602406 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.603349 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.603350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.603815 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.603816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.604317 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.604318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.604357 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.604781 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.604785 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.606570 (+ 1785us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":41}
W20260808 05:03:46.606760 24746 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:03:46.606809 24544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:46.602081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:55765 (local address 127.11.70.254:37183)
0808 05:03:46.602145 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.602148 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.602165 (+ 17us) server_negotiation.cc:407] Connection header received
0808 05:03:46.602188 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.602189 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.602200 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.602264 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.602500 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.603247 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.603900 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.604232 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.604309 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.606673 (+ 2364us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:55765: BlockingRecv error: recv got EOF from 127.11.70.194:55765 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260808 05:03:46.680330 24752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:03:46.680603 24752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:03:46.680626 24752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:03:46.681722 24752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:03:46.681756 24752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:03:46.681780 24752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:03:46.683145 24752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37439
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/krb5kdc/oryx_127.11.70.195.keytab
--principal=oryx/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:33437
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=45391
--tserver_master_addrs=127.11.70.254:37183
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:03:46.683323 24752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:03:46.683488 24752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:03:46.688529 24760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:46.688602 24757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:03:46.688621 24758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:03:46.688925 24752 server_base.cc:1034] running on GCE node
I20260808 05:03:46.689121 24752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:03:46.689383 24752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:03:46.690548 24752 hybrid_clock.cc:648] HybridClock initialized: now 1786165426690532 us; error 28 us; skew 500 ppm
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165426, etypes {rep=17 tkt=17 ses=17}, oryx/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:03:46.693123 24752 init.cc:377] Logged in from keytab as oryx/127.11.70.195@KRBTEST.COM (short username oryx)
I20260808 05:03:46.693670 24752 webserver.cc:460] Webserver started at http://127.11.70.195:45391/ using document root <none> and password file <none>
I20260808 05:03:46.693929 24752 fs_manager.cc:359] Metadata directory not provided
I20260808 05:03:46.694020 24752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:03:46.695596 24752 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:46.696228 24772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.696439 24752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:03:46.696605 24752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "9aa39c4f1db74c3bacc86f5b364bb909"
format_stamp: "Formatted at 2026-08-08 05:03:45 on dist-test-slave-7kzw"
server_key: "47dbbbfa04ca5b695a7e3d81cba472ff"
server_key_iv: "c127dd84ad3830737d2ac10483191cd6"
server_key_version: "encryptionkey@0"
I20260808 05:03:46.696949 24752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:03:46.721143 24752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:03:46.723763 24752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:03:46.723937 24752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:03:46.724180 24752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:03:46.724529 24752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:03:46.724586 24752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.724632 24752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:03:46.724658 24752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:03:46.730911 24752 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:33437
I20260808 05:03:46.730948 24973 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:33437 every 8 connection(s)
I20260808 05:03:46.731326 24752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:03:46.738842 24544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:46.732109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:48687 (local address 127.11.70.254:37183)
0808 05:03:46.732191 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.732194 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.732399 (+ 205us) server_negotiation.cc:407] Connection header received
0808 05:03:46.732954 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.732955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.732969 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.733023 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.733986 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.734545 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.735552 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.735753 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.735831 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.738783 (+ 2952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:48687: BlockingRecv error: recv got EOF from 127.11.70.195:48687 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:03:46.738903 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.732082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:48687)
0808 05:03:46.732276 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.732314 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.732831 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.733093 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.733097 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.733683 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.733879 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.733883 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.734642 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.734643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.735442 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.735444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.735841 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.735842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.735976 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.736473 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.736482 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.738703 (+ 2221us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":68,"threads_started":1}
W20260808 05:03:46.739133 24975 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:37183 (0 consecutive failures): Not authorized: Failed to ping master at 127.11.70.254:37183: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
I20260808 05:03:46.741395 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 24752
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:46.744096 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.739365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:38731)
0808 05:03:46.739420 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.739430 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.739472 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.739740 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.739741 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.739850 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.739900 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.739902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.740635 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.740636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.741119 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.741121 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.741530 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.741532 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.741611 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.742068 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.742073 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.744040 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 05:03:46.744208 24544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:46.739541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:38731 (local address 127.11.70.254:37183)
0808 05:03:46.739621 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.739623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.739633 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:46.739653 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.739654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.739663 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.739722 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.739968 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.740417 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.741244 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.741420 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.741518 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.744147 (+ 2629us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:38731: BlockingRecv error: recv got EOF from 127.11.70.195:38731 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:46 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:46.748453 24977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.744436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:53259)
0808 05:03:46.744471 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:46.744481 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:46.744527 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:46.744671 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:46.744672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:46.744797 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:46.744821 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.744823 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.745420 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.745421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.745900 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:46.745902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.746258 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.746259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:46.746317 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.746715 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:46.746720 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:46.748375 (+ 1655us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":19}
W20260808 05:03:46.748507 24544 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:46.744498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:53259 (local address 127.11.70.254:37183)
0808 05:03:46.744552 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.744554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.744561 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:03:46.744584 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.744585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.744593 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.744667 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.744904 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.745338 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.745985 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.746175 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.746245 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.748441 (+ 2196us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:53259: BlockingRecv error: recv got EOF from 127.11.70.195:53259 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 05:03:46.748695 24975 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:03:46.749837 24979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:46.742011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40684 (local address 127.11.70.254:37183)
0808 05:03:46.742183 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:46.742185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:46.742194 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:46.742216 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:46.742216 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:46.742228 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:46.742304 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:46.743113 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.743749 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.744796 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:46.744991 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:46.745066 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:46.746275 (+ 1209us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:03:46.746281 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:03:46.746281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:03:46.746299 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:03:46.748186 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:46.748716 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:46.748720 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:46.748720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:46.748849 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:03:46.749086 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:03:46.749087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:03:46.749088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:03:46.749340 (+ 252us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:03:46.749495 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 05:03:46.749612 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 05:03:46.749731 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":92,"threads_started":1}
Aug 08 05:03:47 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:47 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:47.474557 24981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:47.469770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:54639)
0808 05:03:47.469917 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:47.469930 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:47.470002 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:47.470136 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:47.470137 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:47.470315 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:47.470365 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:47.470366 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.471106 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.471107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:47.471654 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:47.471655 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.472018 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.472019 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:47.472064 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:47.472520 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:47.472525 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:47.474431 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":84,"threads_started":1}
W20260808 05:03:47.474732 24982 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:47.469864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:54639 (local address 127.11.70.254:37183)
0808 05:03:47.470003 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:47.470006 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:47.470032 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:03:47.470053 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:47.470053 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:47.470064 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:47.470116 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:47.470433 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.471036 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.471736 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.471948 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.472003 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:47.474578 (+ 2575us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:54639: BlockingRecv error: recv got EOF from 127.11.70.193:54639 (error 108)
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
Aug 08 05:03:47 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:47 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:47.612501 24985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:47.607162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:37423)
0808 05:03:47.607386 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:47.607416 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:47.607511 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:47.607648 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:47.607649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:47.607871 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:47.607923 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:47.607926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.608646 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.608648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:47.609205 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:47.609207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.609585 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.609586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:47.609647 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:47.610181 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:47.610186 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:47.612424 (+ 2238us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":116,"threads_started":1}
W20260808 05:03:47.612632 24982 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:47.607292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:37423 (local address 127.11.70.254:37183)
0808 05:03:47.607390 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:47.607392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:47.607492 (+ 100us) server_negotiation.cc:407] Connection header received
0808 05:03:47.607570 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:47.607572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:47.607585 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:47.607634 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:47.608013 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.608546 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.609297 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.609507 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.609587 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:47.612530 (+ 2943us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:37423: BlockingRecv error: recv got EOF from 127.11.70.194:37423 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 08 05:03:47 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:47 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:47.754148 24986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:47.749147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:35273)
0808 05:03:47.749348 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:47.749359 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:47.749425 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:47.749557 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:47.749557 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:47.749751 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:47.749803 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:47.749804 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.750454 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.750455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:47.751380 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:47.751383 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.751709 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.751709 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:47.751762 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:47.752190 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:47.752195 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:47.754078 (+ 1883us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":86,"threads_started":1}
W20260808 05:03:47.754295 24982 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:47.749240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:35273 (local address 127.11.70.254:37183)
0808 05:03:47.749330 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:47.749332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:47.749426 (+ 94us) server_negotiation.cc:407] Connection header received
0808 05:03:47.749472 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:47.749472 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:47.749485 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:47.749538 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:47.749869 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.750379 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.751447 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:47.751639 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:47.751700 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:47.754207 (+ 2507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:35273: BlockingRecv error: recv got EOF from 127.11.70.195:35273 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 08 05:03:48 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:48 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:48.479825 24987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:48.475031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:37399)
0808 05:03:48.475189 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:48.475200 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:48.475259 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:48.475386 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:48.475386 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:48.475561 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:48.475611 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:48.475613 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.476261 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.476262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:48.476786 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:48.476787 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.477142 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.477143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:48.477218 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:48.477740 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:48.477745 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:48.479724 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
W20260808 05:03:48.479889 24988 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:48.475128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:37399 (local address 127.11.70.254:37183)
0808 05:03:48.475262 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:48.475264 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:48.475275 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:48.475299 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:48.475299 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:48.475309 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:48.475368 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:48.475684 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.476189 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.476855 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.477053 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.477137 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:48.479815 (+ 2678us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:37399: BlockingRecv error: recv got EOF from 127.11.70.193:37399 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":63,"threads_started":1}
Aug 08 05:03:48 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:48 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:48.617931 24989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:48.612948 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:56069)
0808 05:03:48.613086 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:48.613098 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:48.613160 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:48.613382 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:48.613384 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:48.613579 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:48.613633 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:48.613635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.614382 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.614384 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:48.614945 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:48.614947 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.615317 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.615318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:48.615375 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:48.615915 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:48.615921 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:48.617828 (+ 1907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":83,"threads_started":1}
W20260808 05:03:48.617985 24988 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:48.613167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:56069 (local address 127.11.70.254:37183)
0808 05:03:48.613245 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:48.613247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:48.613261 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:03:48.613285 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:48.613286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:48.613296 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:48.613357 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:48.613720 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.614277 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.615036 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.615236 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.615318 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:48.617915 (+ 2597us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:56069: BlockingRecv error: recv got EOF from 127.11.70.194:56069 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 05:03:48 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:48 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:48.759580 24990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:48.754721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:42219)
0808 05:03:48.754937 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:48.754949 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:48.755012 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:48.755214 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:48.755216 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:48.755388 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:48.755443 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:48.755445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.756244 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.756245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:48.756768 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:48.756769 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.757183 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.757184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:48.757228 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:48.757673 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:48.757678 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:48.759480 (+ 1802us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":123,"threads_started":1}
W20260808 05:03:48.759635 24988 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:48.754880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:42219 (local address 127.11.70.254:37183)
0808 05:03:48.754961 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:48.754963 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:48.754996 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:03:48.755089 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:48.755089 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:48.755105 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:48.755181 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:48.755592 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.756155 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.756861 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:48.757120 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:48.757183 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:48.759566 (+ 2383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:42219: BlockingRecv error: recv got EOF from 127.11.70.195:42219 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 05:03:49 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:49 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:49.489459 24991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:49.480433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:53855)
0808 05:03:49.480587 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:49.480598 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:49.480648 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:49.480800 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:49.480801 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:49.480978 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:49.481033 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:49.481035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.481762 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.481763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:49.482322 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:49.482324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.482731 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.482732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:49.482781 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:49.487561 (+ 4780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:49.487566 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:49.489397 (+ 1831us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":90,"threads_started":1}
W20260808 05:03:49.489629 24993 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:49.480484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:53855 (local address 127.11.70.254:37183)
0808 05:03:49.480621 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:49.480623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:49.480634 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:49.480719 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:49.480719 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:49.480730 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:49.480795 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:49.481095 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.481593 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.482432 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.482652 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.482715 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:49.489526 (+ 6811us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:53855: BlockingRecv error: recv got EOF from 127.11.70.193:53855 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
Aug 08 05:03:49 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:49 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:49.623474 24994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:49.618496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:39105)
0808 05:03:49.618670 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:49.618681 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:49.618748 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:49.618889 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:49.618890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:49.619063 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:49.619115 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:49.619117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.620080 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.620081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:49.620620 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:49.620622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.620953 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.620954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:49.620999 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:49.621524 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:49.621529 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:49.623411 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":84,"threads_started":1}
W20260808 05:03:49.623597 24993 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:49.618621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:39105 (local address 127.11.70.254:37183)
0808 05:03:49.618688 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:49.618690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:49.618748 (+ 58us) server_negotiation.cc:407] Connection header received
0808 05:03:49.618797 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:49.618798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:49.618810 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:49.618868 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:49.619183 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.619975 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.620699 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.620883 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.620936 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:49.623507 (+ 2571us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:39105: BlockingRecv error: recv got EOF from 127.11.70.194:39105 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 05:03:49 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:49 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:49.765511 24995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:49.760140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:52767)
0808 05:03:49.760312 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:49.760323 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:49.760383 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:49.760502 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:49.760503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:49.760679 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:49.760728 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:49.760730 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.761540 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.761541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:49.762362 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:49.762365 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.762859 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.762860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:49.762912 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:49.763440 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:49.763445 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:49.765407 (+ 1962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":113,"threads_started":1}
W20260808 05:03:49.765550 24993 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:49.760201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:52767 (local address 127.11.70.254:37183)
0808 05:03:49.760283 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:49.760285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:49.760388 (+ 103us) server_negotiation.cc:407] Connection header received
0808 05:03:49.760430 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:49.760431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:49.760442 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:49.760494 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:49.760826 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.761434 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.762458 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:49.762664 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:49.762756 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:49.765488 (+ 2732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:52767: BlockingRecv error: recv got EOF from 127.11.70.195:52767 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 08 05:03:50 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:50 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:50.494822 24996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:50.489954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:57245)
0808 05:03:50.490104 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:50.490123 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:50.490173 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:50.490357 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:50.490357 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:50.490592 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:50.490645 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:50.490648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.491292 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.491293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:50.491819 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:50.491820 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.492131 (+ 311us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.492132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:50.492171 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:50.492736 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:50.492743 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:50.494718 (+ 1975us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":90,"threads_started":1}
W20260808 05:03:50.494869 24997 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:50.490069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:57245 (local address 127.11.70.254:37183)
0808 05:03:50.490218 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:50.490220 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:50.490228 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:50.490251 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:50.490252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:50.490263 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:50.490337 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:50.490718 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.491218 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.491888 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.492069 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.492120 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:50.494799 (+ 2679us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:57245: BlockingRecv error: recv got EOF from 127.11.70.193:57245 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
Aug 08 05:03:50 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:50 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:50.628933 24998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:50.623930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:59623)
0808 05:03:50.624086 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:50.624098 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:50.624166 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:50.624324 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:50.624325 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:50.624514 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:50.624602 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:50.624604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.625278 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.625279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:50.625833 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:50.625835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.626200 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.626201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:50.626243 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:50.626802 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:50.626807 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:50.628829 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":101,"threads_started":1}
W20260808 05:03:50.628978 24997 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:50.623997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:59623 (local address 127.11.70.254:37183)
0808 05:03:50.624045 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:50.624047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:50.624169 (+ 122us) server_negotiation.cc:407] Connection header received
0808 05:03:50.624213 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:50.624214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:50.624227 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:50.624284 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:50.624679 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.625200 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.625924 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.626129 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.626193 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:50.628913 (+ 2720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:59623: BlockingRecv error: recv got EOF from 127.11.70.194:59623 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 05:03:50 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:50 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:50.770720 24999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:50.766017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:48107)
0808 05:03:50.766175 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:50.766188 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:50.766246 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:50.766419 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:50.766420 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:50.766609 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:50.766660 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:50.766661 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.767352 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.767353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:50.767871 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:50.767872 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.768288 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.768289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:50.768333 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:50.768783 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:50.768788 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:50.770657 (+ 1869us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":99,"threads_started":1}
W20260808 05:03:50.770969 24997 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:50.766130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:48107 (local address 127.11.70.254:37183)
0808 05:03:50.766204 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:50.766206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:50.766229 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:03:50.766333 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:50.766334 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:50.766347 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:50.766407 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:50.766754 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.767276 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.767983 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:50.768197 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:50.768296 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:50.770885 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:48107: BlockingRecv error: recv got EOF from 127.11.70.195:48107 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 05:03:51 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:51 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:51.500725 25001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:51.495361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:43741)
0808 05:03:51.495512 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:51.495525 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:51.495629 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:51.495776 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:51.495777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:51.495961 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:51.496015 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:51.496017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.496768 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.496769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:51.497357 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:51.497359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.497760 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.497761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:51.497809 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:51.498322 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:51.498327 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:51.500662 (+ 2335us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
W20260808 05:03:51.500887 25002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:51.495478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:43741 (local address 127.11.70.254:37183)
0808 05:03:51.495643 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:51.495645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:51.495654 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:51.495678 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:51.495679 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:51.495690 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:51.495756 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:51.496097 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.496680 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.497438 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.497679 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.497737 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:51.500789 (+ 3052us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:43741: BlockingRecv error: recv got EOF from 127.11.70.193:43741 (error 108)
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":94,"threads_started":1}
Aug 08 05:03:51 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:51 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:51.634459 25003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:51.629474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:48595)
0808 05:03:51.629649 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:51.629660 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:51.629708 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:51.629856 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:51.629857 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:51.630034 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:51.630088 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:51.630090 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.630823 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.630824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:51.631347 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:51.631348 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.631731 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.631732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:51.631777 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:51.632249 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:51.632253 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:51.634350 (+ 2097us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":102,"threads_started":1}
W20260808 05:03:51.634562 25002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:51.629640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:48595 (local address 127.11.70.254:37183)
0808 05:03:51.629691 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:51.629694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:51.629709 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:03:51.629760 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:51.629761 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:51.629773 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:51.629833 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:51.630162 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.630743 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.631434 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.631654 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.631721 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:51.634442 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:48595: BlockingRecv error: recv got EOF from 127.11.70.194:48595 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 08 05:03:51 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:51 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:51.776333 25005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:51.771287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:51763)
0808 05:03:51.771473 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:51.771485 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:51.771568 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:51.771760 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:51.771761 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:51.771937 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:51.771989 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:51.771991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.772773 (+ 782us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.772774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:51.773294 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:51.773296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.773679 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.773680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:51.773740 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:51.774336 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:51.774341 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:51.776272 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":102,"threads_started":1}
W20260808 05:03:51.776492 25002 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:51.771334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:51763 (local address 127.11.70.254:37183)
0808 05:03:51.771406 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:51.771409 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:51.771592 (+ 183us) server_negotiation.cc:407] Connection header received
0808 05:03:51.771631 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:51.771632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:51.771646 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:51.771704 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:51.772103 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.772690 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.773390 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:51.773597 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:51.773664 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:51.776420 (+ 2756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:51763: BlockingRecv error: recv got EOF from 127.11.70.195:51763 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 05:03:52 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:52 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:52.505988 25006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:52.501312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:40601)
0808 05:03:52.501458 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:52.501472 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:52.501554 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:52.501712 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:52.501713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:52.501910 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:52.501959 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:52.501961 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.502651 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.502652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:52.503176 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:52.503178 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.503504 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.503505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:52.503548 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:52.504004 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:52.504008 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:52.505924 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
W20260808 05:03:52.506204 25009 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:52.501374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:40601 (local address 127.11.70.254:37183)
0808 05:03:52.501479 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:52.501482 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:52.501550 (+ 68us) server_negotiation.cc:407] Connection header received
0808 05:03:52.501627 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:52.501628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:52.501640 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:52.501706 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:52.502021 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.502551 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.503248 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.503439 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.503489 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:52.506107 (+ 2618us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:40601: BlockingRecv error: recv got EOF from 127.11.70.193:40601 (error 108)
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":56,"threads_started":1}
Aug 08 05:03:52 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:52 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:52.640547 25011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:52.635247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:46797)
0808 05:03:52.635420 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:52.635430 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:52.635490 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:52.635634 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:52.635635 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:52.635825 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:52.635879 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:52.635881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.636674 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.636675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:52.637437 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:52.637441 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.637832 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.637833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:52.637876 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:52.638422 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:52.638427 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:52.640484 (+ 2057us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":109,"threads_started":1}
W20260808 05:03:52.640703 25009 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:52.635355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:46797 (local address 127.11.70.254:37183)
0808 05:03:52.635409 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:52.635411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:52.635486 (+ 75us) server_negotiation.cc:407] Connection header received
0808 05:03:52.635539 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:52.635540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:52.635551 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:52.635605 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:52.635941 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.636524 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.637517 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.637746 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.637808 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:52.640587 (+ 2779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:46797: BlockingRecv error: recv got EOF from 127.11.70.194:46797 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Aug 08 05:03:52 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:52 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:52.781659 25013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:52.776808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:38207)
0808 05:03:52.776996 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:52.777008 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:52.777094 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:52.777313 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:52.777314 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:52.777503 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:52.777552 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:52.777554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.778430 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.778431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:52.779014 (+ 583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:52.779016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.779344 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.779345 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:52.779385 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:52.779832 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:52.779837 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:52.781599 (+ 1762us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":78,"threads_started":1}
W20260808 05:03:52.781762 25009 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:52.777004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:38207 (local address 127.11.70.254:37183)
0808 05:03:52.777068 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:52.777070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:52.777081 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:03:52.777205 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:52.777206 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:52.777222 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:52.777303 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:52.777680 (+ 377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.778359 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.779091 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:52.779278 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:52.779333 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:52.781694 (+ 2361us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:38207: BlockingRecv error: recv got EOF from 127.11.70.195:38207 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 05:03:53 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:53 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:53.511314 25014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:53.506533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:47323)
0808 05:03:53.506683 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:53.506695 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:53.506792 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:53.506957 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:53.506958 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:53.507185 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:53.507296 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:53.507299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.508033 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.508033 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:53.508557 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:53.508558 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.508926 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.508927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:53.508969 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:53.509427 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:53.509432 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:53.511254 (+ 1822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":63,"threads_started":1}
W20260808 05:03:53.511418 25016 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:53.506600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:47323 (local address 127.11.70.254:37183)
0808 05:03:53.506764 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:53.506766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:53.506802 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:03:53.506839 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:53.506840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:53.506854 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:53.506936 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:53.507381 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.507960 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.508655 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.508852 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.508914 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:53.511343 (+ 2429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:47323: BlockingRecv error: recv got EOF from 127.11.70.193:47323 (error 108)
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
Aug 08 05:03:53 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:53 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:53.645897 25017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:53.641058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:35229)
0808 05:03:53.641251 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:53.641266 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:53.641343 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:53.641482 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:53.641484 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:53.641679 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:53.641743 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:53.641745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.642437 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.642438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:53.643010 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:53.643012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.643392 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.643394 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:53.643453 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:53.643950 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:53.643955 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:53.645797 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":94,"threads_started":1}
W20260808 05:03:53.645957 25016 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:53.641162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:35229 (local address 127.11.70.254:37183)
0808 05:03:53.641255 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:53.641258 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:53.641333 (+ 75us) server_negotiation.cc:407] Connection header received
0808 05:03:53.641404 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:53.641405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:53.641419 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:53.641467 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:53.641830 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.642347 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.643105 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.643313 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.643394 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:53.645891 (+ 2497us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:35229: BlockingRecv error: recv got EOF from 127.11.70.194:35229 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 08 05:03:53 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:53 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:53.787317 25020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:53.782205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:35027)
0808 05:03:53.782407 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:53.782422 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:53.782528 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:53.782779 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:53.782781 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:53.782993 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:53.783044 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:53.783046 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.783729 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.783730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:53.784272 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:53.784273 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.784648 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.784650 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:53.784712 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:53.785240 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:53.785248 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:53.787191 (+ 1943us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":109,"threads_started":1}
W20260808 05:03:53.787351 25016 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:53.782328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:35027 (local address 127.11.70.254:37183)
0808 05:03:53.782411 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:53.782414 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:53.782507 (+ 93us) server_negotiation.cc:407] Connection header received
0808 05:03:53.782641 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:53.782642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:53.782698 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:53.782769 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:53.783131 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.783635 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.784364 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:53.784571 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:53.784657 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:53.787282 (+ 2625us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:35027: BlockingRecv error: recv got EOF from 127.11.70.195:35027 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 08 05:03:54 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:54 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:54.520421 25021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:54.511962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:36043)
0808 05:03:54.512165 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:54.512179 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:54.512280 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:54.512467 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:54.512468 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:54.512684 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:54.512739 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:54.512741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.513429 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.513430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:54.514033 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:54.514034 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.514380 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.514381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:54.514426 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:54.518313 (+ 3887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:54.518318 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:54.520356 (+ 2038us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":119,"threads_started":1}
W20260808 05:03:54.520534 25022 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:54.512086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:36043 (local address 127.11.70.254:37183)
0808 05:03:54.512220 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:54.512223 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:54.512257 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:03:54.512361 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:54.512362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:54.512374 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:54.512429 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:54.512835 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.513348 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.514108 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.514313 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.514364 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:54.520451 (+ 6087us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:36043: BlockingRecv error: recv got EOF from 127.11.70.193:36043 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":76,"threads_started":1}
Aug 08 05:03:54 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:54 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:54.651443 25023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:54.646450 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:43803)
0808 05:03:54.646662 (+ 212us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:54.646674 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:54.646739 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:54.646870 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:54.646871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:54.647065 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:54.647120 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:54.647121 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.647937 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.647938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:54.648478 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:54.648480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.648809 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.648810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:54.648852 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:54.649324 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:54.649329 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:54.651335 (+ 2006us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":95,"threads_started":1}
W20260808 05:03:54.651655 25022 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:54.646583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:43803 (local address 127.11.70.254:37183)
0808 05:03:54.646659 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:54.646661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:54.646750 (+ 89us) server_negotiation.cc:407] Connection header received
0808 05:03:54.646781 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:54.646782 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:54.646793 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:54.646845 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:54.647185 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.647845 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.648555 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.648743 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.648793 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:54.651470 (+ 2677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:43803: BlockingRecv error: recv got EOF from 127.11.70.194:43803 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 08 05:03:54 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:54 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:54.792724 25024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:54.787844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:60963)
0808 05:03:54.787993 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:54.788005 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:54.788076 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:54.788216 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:54.788217 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:54.788397 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:54.788447 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:54.788449 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.789097 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.789098 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:54.789637 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:54.789638 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.789983 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.789984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:54.790029 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:54.790570 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:54.790576 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:54.792629 (+ 2053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":91,"threads_started":1}
W20260808 05:03:54.792786 25022 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:54.787925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:60963 (local address 127.11.70.254:37183)
0808 05:03:54.788019 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:54.788021 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:54.788077 (+ 56us) server_negotiation.cc:407] Connection header received
0808 05:03:54.788129 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:54.788130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:54.788143 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:54.788199 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:54.788520 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.789026 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.789718 (+ 692us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:54.789908 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:54.789965 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:54.792735 (+ 2770us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:60963: BlockingRecv error: recv got EOF from 127.11.70.195:60963 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 08 05:03:55 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:55 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:55.526190 25025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:55.520922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:48241)
0808 05:03:55.521139 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:55.521152 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:55.521224 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:55.521373 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:55.521374 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:55.521572 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:55.521630 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:55.521632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.522300 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.522301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:55.522986 (+ 685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:55.522989 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.523386 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.523388 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:55.523437 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:55.524110 (+ 673us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:55.524115 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:55.526118 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":98,"threads_started":1}
W20260808 05:03:55.526448 25027 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:55.521020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:48241 (local address 127.11.70.254:37183)
0808 05:03:55.521166 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:55.521168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:55.521219 (+ 51us) server_negotiation.cc:407] Connection header received
0808 05:03:55.521279 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:55.521279 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:55.521289 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:55.521347 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:55.521700 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.522222 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.523074 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.523304 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.523373 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:55.526362 (+ 2989us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:48241: BlockingRecv error: recv got EOF from 127.11.70.193:48241 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
Aug 08 05:03:55 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:55 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:55.656663 25028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:55.651939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:56239)
0808 05:03:55.652088 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:55.652099 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:55.652171 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:55.652299 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:55.652300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:55.652480 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:55.652532 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:55.652534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.653186 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.653187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:55.653717 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:55.653718 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.654032 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.654033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:55.654074 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:55.654570 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:55.654576 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:55.656600 (+ 2024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":92,"threads_started":1}
W20260808 05:03:55.656786 25027 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:55.652013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:56239 (local address 127.11.70.254:37183)
0808 05:03:55.652080 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:55.652083 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:55.652182 (+ 99us) server_negotiation.cc:407] Connection header received
0808 05:03:55.652211 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:55.652211 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:55.652223 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:55.652278 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:55.652597 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.653113 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.653787 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.653966 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.654018 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:55.656694 (+ 2676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:56239: BlockingRecv error: recv got EOF from 127.11.70.194:56239 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 08 05:03:55 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:55 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:55.798454 25030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:55.793377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:40247)
0808 05:03:55.793520 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:55.793531 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:55.793590 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:55.793705 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:55.793706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:55.793895 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:55.793948 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:55.793949 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.794623 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.794623 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:55.795646 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:55.795650 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.795987 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.795988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:55.796027 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:55.796473 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:55.796478 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:55.798382 (+ 1904us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":71,"threads_started":1}
W20260808 05:03:55.798614 25027 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:55.793453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:40247 (local address 127.11.70.254:37183)
0808 05:03:55.793530 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:55.793532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:55.793599 (+ 67us) server_negotiation.cc:407] Connection header received
0808 05:03:55.793627 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:55.793628 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:55.793641 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:55.793701 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:55.794031 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.794554 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.795735 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:55.795921 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:55.795977 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:55.798514 (+ 2537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:40247: BlockingRecv error: recv got EOF from 127.11.70.195:40247 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 05:03:56 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:56 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:56.531772 25032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:56.526823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:53117)
0808 05:03:56.526961 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:56.526974 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:56.527036 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:56.527184 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:56.527184 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:56.527437 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:56.527489 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:56.527491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.528259 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.528260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:56.528776 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:56.528777 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.529103 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.529104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:56.529142 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:56.529605 (+ 463us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:56.529610 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:56.531669 (+ 2059us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":79,"threads_started":1}
W20260808 05:03:56.531822 25034 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:56.526862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:53117 (local address 127.11.70.254:37183)
0808 05:03:56.527016 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:56.527018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:56.527028 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:03:56.527081 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:56.527082 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:56.527100 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:56.527163 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:56.527582 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.528186 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.528846 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.529037 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.529097 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:56.531750 (+ 2653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:53117: BlockingRecv error: recv got EOF from 127.11.70.193:53117 (error 108)
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
Aug 08 05:03:56 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:56 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:56.662204 25035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:56.657384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:51541)
0808 05:03:56.657538 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:56.657551 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:56.657633 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:56.657805 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:56.657806 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:56.657987 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:56.658039 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:56.658040 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.658707 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.658708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:56.659228 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:56.659230 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.659546 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.659547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:56.659587 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:56.660096 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:56.660101 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:56.662120 (+ 2019us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":74,"threads_started":1}
W20260808 05:03:56.662295 25034 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:56.657477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:51541 (local address 127.11.70.254:37183)
0808 05:03:56.657556 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:56.657558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:56.657607 (+ 49us) server_negotiation.cc:407] Connection header received
0808 05:03:56.657720 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:56.657721 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:56.657732 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:56.657783 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:56.658099 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.658624 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.659301 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.659483 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.659534 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:56.662211 (+ 2677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:51541: BlockingRecv error: recv got EOF from 127.11.70.194:51541 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 08 05:03:56 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:56 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:56.804049 25036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:56.798980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:43281)
0808 05:03:56.799176 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:56.799190 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:56.799254 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:56.799369 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:56.799370 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:56.799543 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:56.799596 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:56.799597 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.800301 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.800302 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:56.800863 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:56.800865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.801222 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.801224 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:56.801282 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:56.801842 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:56.801849 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:56.803947 (+ 2098us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":100,"threads_started":1}
W20260808 05:03:56.804088 25034 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:56.799140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:43281 (local address 127.11.70.254:37183)
0808 05:03:56.799237 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:56.799239 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:56.799248 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:03:56.799305 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:56.799306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:56.799317 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:56.799363 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:56.799649 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.800198 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.800927 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:56.801113 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:56.801186 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:56.804025 (+ 2839us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:43281: BlockingRecv error: recv got EOF from 127.11.70.195:43281 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 08 05:03:57 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:57 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:57.537122 25039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:57.532268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:44599)
0808 05:03:57.532420 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:57.532434 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:57.532497 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:57.532628 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:57.532628 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:57.532814 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:57.532864 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:57.532866 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.533506 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.533506 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:57.534044 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:57.534045 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.534375 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.534376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:57.534427 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:57.534996 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:57.535000 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:57.537010 (+ 2010us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":72,"threads_started":1}
W20260808 05:03:57.537222 25043 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:57.532320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:44599 (local address 127.11.70.254:37183)
0808 05:03:57.532475 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:57.532477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:57.532485 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:57.532543 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:57.532544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:57.532554 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:57.532610 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:57.532934 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.533437 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.534117 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.534308 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.534358 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:57.537139 (+ 2781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:44599: BlockingRecv error: recv got EOF from 127.11.70.193:44599 (error 108)
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":89,"threads_started":1}
Aug 08 05:03:57 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:57 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:57.669181 25044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:57.662853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:60693)
0808 05:03:57.663030 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:57.663044 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:57.663122 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:57.663320 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:57.663321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:57.663573 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:57.663638 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:57.663640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.664558 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.664560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:57.665497 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:57.665501 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.665991 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.665993 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:57.666057 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:57.666678 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:57.666683 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:57.669057 (+ 2374us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":81,"threads_started":1}
W20260808 05:03:57.669238 25043 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:57.662938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:60693 (local address 127.11.70.254:37183)
0808 05:03:57.663039 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:57.663041 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:57.663118 (+ 77us) server_negotiation.cc:407] Connection header received
0808 05:03:57.663204 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:57.663205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:57.663217 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:57.663299 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:57.663733 (+ 434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.664493 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.665583 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.665901 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.665967 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:57.669168 (+ 3201us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:60693: BlockingRecv error: recv got EOF from 127.11.70.194:60693 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Aug 08 05:03:57 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:57 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:57.809600 25046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:57.804603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:36569)
0808 05:03:57.804779 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:57.804790 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:57.804847 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:57.804982 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:57.804983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:57.805166 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:57.805217 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:57.805219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.805982 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.805983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:57.806601 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:57.806603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.807080 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.807081 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:57.807146 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:57.807686 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:57.807690 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:57.809528 (+ 1838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":113,"threads_started":1}
W20260808 05:03:57.809679 25043 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:57.804673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:36569 (local address 127.11.70.254:37183)
0808 05:03:57.804769 (+ 96us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:57.804771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:57.804853 (+ 82us) server_negotiation.cc:407] Connection header received
0808 05:03:57.804896 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:57.804896 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:57.804909 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:57.804967 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:57.805375 (+ 408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.805900 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.806764 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:57.806980 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:57.807078 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:57.809630 (+ 2552us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:36569: BlockingRecv error: recv got EOF from 127.11.70.195:36569 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 08 05:03:58 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:58 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:58.546166 25047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:58.537663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:54829)
0808 05:03:58.537828 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:58.537839 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:58.537890 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:58.538044 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:58.538045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:58.538231 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:58.538284 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:58.538286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.538936 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.538936 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:58.539454 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:58.539455 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.539797 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.539798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:58.539838 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:58.543380 (+ 3542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:58.543387 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:58.546057 (+ 2670us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":95,"threads_started":1}
W20260808 05:03:58.546267 25048 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:58.537763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:54829 (local address 127.11.70.254:37183)
0808 05:03:58.537889 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:58.537891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:58.537899 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:03:58.537939 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:58.537939 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:58.537949 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:58.538013 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:58.538350 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.538868 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.539529 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.539730 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.539784 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:58.546161 (+ 6377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:54829: BlockingRecv error: recv got EOF from 127.11.70.193:54829 (error 108)
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":72,"threads_started":1}
Aug 08 05:03:58 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:58 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:58.674515 25049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:58.669702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:45449)
0808 05:03:58.669863 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:58.669875 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:58.669938 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:58.670063 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:58.670064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:58.670257 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:58.670305 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:58.670307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.671044 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.671045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:58.671577 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:58.671578 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.671925 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.671926 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:58.671971 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:58.672415 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:58.672420 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:58.674436 (+ 2016us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":94,"threads_started":1}
W20260808 05:03:58.674762 25048 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:58.669763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:45449 (local address 127.11.70.254:37183)
0808 05:03:58.669829 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:58.669832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:58.669950 (+ 118us) server_negotiation.cc:407] Connection header received
0808 05:03:58.669981 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:58.669982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:58.669993 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:58.670049 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:58.670369 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.670974 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.671673 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.671857 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.671913 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:58.674707 (+ 2794us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:45449: BlockingRecv error: recv got EOF from 127.11.70.194:45449 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 05:03:58 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:58 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:58.815212 25053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:58.810199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:36585)
0808 05:03:58.810346 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:58.810357 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:58.810419 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:58.810608 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:58.810608 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:58.810816 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:58.810866 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:58.810868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.811531 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.811532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:58.812081 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:58.812082 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.812430 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.812430 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:58.812470 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:58.812903 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:58.812907 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:58.815126 (+ 2219us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":98,"threads_started":1}
W20260808 05:03:58.815277 25048 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:58.810241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:36585 (local address 127.11.70.254:37183)
0808 05:03:58.810312 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:58.810315 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:58.810420 (+ 105us) server_negotiation.cc:407] Connection header received
0808 05:03:58.810506 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:58.810507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:58.810522 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:58.810583 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:58.810963 (+ 380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.811455 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.812164 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:58.812358 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:58.812418 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:58.815227 (+ 2809us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:36585: BlockingRecv error: recv got EOF from 127.11.70.195:36585 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 08 05:03:59 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:59 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:59.554025 25054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:59.546643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:56461)
0808 05:03:59.546820 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:59.546831 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:59.546891 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:59.547013 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:59.547014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:59.547198 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:59.547247 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:59.547264 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.547938 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.547939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:59.548477 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:59.548478 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.548814 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.548814 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:59.548858 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:59.552086 (+ 3228us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:59.552091 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:59.553963 (+ 1872us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":99,"threads_started":1}
W20260808 05:03:59.554224 25055 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:59.546737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:56461 (local address 127.11.70.254:37183)
0808 05:03:59.546895 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:59.546897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:59.546925 (+ 28us) server_negotiation.cc:407] Connection header received
0808 05:03:59.546945 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:59.546945 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:59.546959 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:59.547008 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:59.547329 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.547853 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.548548 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.548745 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.548796 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:59.554090 (+ 5294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:56461: BlockingRecv error: recv got EOF from 127.11.70.193:56461 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
Aug 08 05:03:59 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:59 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:59.679832 25058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:59.675007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:51281)
0808 05:03:59.675209 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:59.675222 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:59.675315 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:59.675488 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:59.675489 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:59.675731 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:59.675809 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:59.675811 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.676450 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.676450 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:59.676986 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:59.676988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.677315 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.677316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:59.677366 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:59.677864 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:59.677869 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:59.679762 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":109,"threads_started":1}
W20260808 05:03:59.679931 25055 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:59.675141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:51281 (local address 127.11.70.254:37183)
0808 05:03:59.675197 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:59.675218 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:59.675300 (+ 82us) server_negotiation.cc:407] Connection header received
0808 05:03:59.675387 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:59.675388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:59.675401 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:59.675483 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:59.675883 (+ 400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.676375 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.677064 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.677248 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.677299 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:59.679860 (+ 2561us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:51281: BlockingRecv error: recv got EOF from 127.11.70.194:51281 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 05:03:59 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:03:59 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:03:59.820523 25059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:03:59.815782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:49957)
0808 05:03:59.815936 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:03:59.815949 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:03:59.816017 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:03:59.816154 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:03:59.816155 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:03:59.816343 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:03:59.816394 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:59.816396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.817126 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.817127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:59.817718 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:03:59.817720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.818145 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.818146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:03:59.818191 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:59.818703 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:03:59.818708 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:03:59.820462 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
W20260808 05:03:59.820708 25055 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:03:59.815836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:49957 (local address 127.11.70.254:37183)
0808 05:03:59.815905 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:03:59.815907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:03:59.816022 (+ 115us) server_negotiation.cc:407] Connection header received
0808 05:03:59.816072 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:03:59.816073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:03:59.816087 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:03:59.816129 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:03:59.816464 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.816988 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.817799 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:03:59.818075 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:03:59.818131 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:03:59.820600 (+ 2469us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:49957: BlockingRecv error: recv got EOF from 127.11.70.195:49957 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 08 05:04:00 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:04:00 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:04:00.559854 25060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:00.554693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:32881)
0808 05:04:00.554878 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:00.554892 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:00.554963 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:00.555120 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:00.555121 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:00.555308 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:00.555358 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:00.555360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.556077 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.556078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:00.556643 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:00.556645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.556985 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.556986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:00.557048 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:00.557635 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:00.557640 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:00.559778 (+ 2138us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":74,"threads_started":1}
W20260808 05:04:00.559981 25062 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:04:00.554752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:32881 (local address 127.11.70.254:37183)
0808 05:04:00.554945 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:00.554946 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:00.554955 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:04:00.555022 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:00.555022 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:00.555032 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:00.555095 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:00.555450 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.555969 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.556723 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.556910 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.556962 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:00.559893 (+ 2931us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:32881: BlockingRecv error: recv got EOF from 127.11.70.193:32881 (error 108)
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":118,"threads_started":1}
Aug 08 05:04:00 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:04:00 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:04:00.685212 25063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:00.680330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:44425)
0808 05:04:00.680543 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:00.680555 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:00.680683 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:00.680877 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:00.680878 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:00.681081 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:00.681138 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:00.681139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.681830 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.681831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:00.682370 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:00.682371 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.682782 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.682783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:00.682841 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:00.683306 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:00.683310 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:00.685113 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":114,"threads_started":1}
W20260808 05:04:00.685277 25062 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:04:00.680423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:44425 (local address 127.11.70.254:37183)
0808 05:04:00.680525 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:00.680528 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:00.680632 (+ 104us) server_negotiation.cc:407] Connection header received
0808 05:04:00.680768 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:00.680769 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:00.680784 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:00.680868 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:00.681229 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.681733 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.682483 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.682689 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.682783 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:00.685214 (+ 2431us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:44425: BlockingRecv error: recv got EOF from 127.11.70.194:44425 (error 108)
Metrics: {"server-negotiator.queue_time_us":67}
Aug 08 05:04:00 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:04:00 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.195@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:04:00.826323 25064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:00.821056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.195:56767)
0808 05:04:00.821241 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:00.821253 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:00.821321 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:00.821447 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:00.821448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:00.821801 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:00.821853 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:00.821856 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.822594 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.822596 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:00.823304 (+ 708us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:00.823307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.823703 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.823704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:00.823757 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:00.824339 (+ 582us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:00.824344 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:00.826257 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":96,"threads_started":1}
W20260808 05:04:00.826428 25062 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:04:00.821195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:56767 (local address 127.11.70.254:37183)
0808 05:04:00.821245 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:00.821247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:00.821317 (+ 70us) server_negotiation.cc:407] Connection header received
0808 05:04:00.821366 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:00.821366 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:00.821378 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:00.821426 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:00.821929 (+ 503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.822422 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.823393 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:00.823606 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:00.823681 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:00.826353 (+ 2672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.195:56767: BlockingRecv error: recv got EOF from 127.11.70.195:56767 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 08 05:04:01 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:04:01 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.193@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:04:01.565277 25065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:01.560406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.193:60927)
0808 05:04:01.560558 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:01.560569 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:01.560617 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:01.560799 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:01.560800 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:01.560975 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:01.561028 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:01.561029 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.561727 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.561728 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:01.562253 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:01.562254 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.562611 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.562612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:01.562656 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:01.563216 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:01.563220 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:01.565216 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":90,"threads_started":1}
W20260808 05:04:01.565442 25066 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:04:01.560491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:60927 (local address 127.11.70.254:37183)
0808 05:04:01.560637 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:01.560638 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:01.560662 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:04:01.560683 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:01.560683 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:01.560693 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:01.560743 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:01.561107 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.561613 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.562336 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.562548 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.562598 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:01.565352 (+ 2754us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.193:60927: BlockingRecv error: recv got EOF from 127.11.70.193:60927 (error 108)
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":86,"threads_started":1}
Aug 08 05:04:01 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:04:01 dist-test-slave-7kzw krb5kdc[23432](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.11.70.194@KRBTEST.COM for oryx/127.11.70.254@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:04:01.691296 25067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:01.685888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37183 (local address 127.11.70.194:44141)
0808 05:04:01.686162 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:01.686188 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:01.686289 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:01.686711 (+ 422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:01.686713 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:01.686930 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:01.686987 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:01.686989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.687757 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.687758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:01.688305 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:01.688306 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.688682 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.688683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:01.688740 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:01.689338 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:01.689343 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:01.691236 (+ 1893us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.11.70.254:37183: Server oryx/127.11.70.254@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":254,"thread_start_us":132,"threads_started":1}
W20260808 05:04:01.691428 25066 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:04:01.686030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:44141 (local address 127.11.70.254:37183)
0808 05:04:01.686145 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:01.686147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:01.686273 (+ 126us) server_negotiation.cc:407] Connection header received
0808 05:04:01.686592 (+ 319us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:01.686593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:01.686609 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:01.686700 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:01.687102 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.687635 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.688398 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.688603 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.688684 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:01.691344 (+ 2660us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.70.194:44141: BlockingRecv error: recv got EOF from 127.11.70.194:44141 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
I20260808 05:04:01.743467 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 24320
I20260808 05:04:01.754830 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 24545
I20260808 05:04:01.762230 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 24752
I20260808 05:04:01.772161 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 24210
2026-08-08T05:04:01Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17727 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T05:04:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:04:01Z Disabled control of system clock
I20260808 05:04:01.805603 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43325
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:43325
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 05:04:01.889344 25073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:01.889568 25073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:01.889588 25073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:01.890839 25073 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:04:01.890882 25073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:01.890894 25073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:01.890908 25073 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:04:01.890919 25073 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:04:01.892203 25073 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:43325
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:01.892397 25073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:01.892637 25073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:01.897631 25088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:01.897632 25083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:01.897648 25084 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:01.898056 25073 server_base.cc:1034] running on GCE node
I20260808 05:04:01.898319 25073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:01.898625 25073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:01.899852 25073 hybrid_clock.cc:648] HybridClock initialized: now 1786165441899838 us; error 31 us; skew 500 ppm
I20260808 05:04:01.901113 25073 webserver.cc:460] Webserver started at http://127.11.70.254:39581/ using document root <none> and password file <none>
I20260808 05:04:01.901340 25073 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:01.901382 25073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:01.901475 25073 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:01.902658 25073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb"
format_stamp: "Formatted at 2026-08-08 05:04:01 on dist-test-slave-7kzw"
server_key: "071c33df55a0fb455e962b28262490a3"
server_key_iv: "04a461ab4ba22aaa6b9d3ac11b1abbcc"
server_key_version: "encryptionkey@0"
I20260808 05:04:01.902977 25073 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb"
format_stamp: "Formatted at 2026-08-08 05:04:01 on dist-test-slave-7kzw"
server_key: "071c33df55a0fb455e962b28262490a3"
server_key_iv: "04a461ab4ba22aaa6b9d3ac11b1abbcc"
server_key_version: "encryptionkey@0"
I20260808 05:04:01.904280 25073 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:04:01.905092 25098 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:01.905309 25073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:01.905443 25073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb"
format_stamp: "Formatted at 2026-08-08 05:04:01 on dist-test-slave-7kzw"
server_key: "071c33df55a0fb455e962b28262490a3"
server_key_iv: "04a461ab4ba22aaa6b9d3ac11b1abbcc"
server_key_version: "encryptionkey@0"
I20260808 05:04:01.905560 25073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:01.937057 25073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:01.937423 25073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:01.937602 25073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:01.941977 25073 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:43325
I20260808 05:04:01.942013 25181 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:43325 every 8 connection(s)
I20260808 05:04:01.942364 25073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:04:01.943084 25182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:01.945739 25182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb: Bootstrap starting.
I20260808 05:04:01.946295 25182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:01.946671 25182 log.cc:824] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:01.947363 25182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb: No bootstrap required, opened a new log
I20260808 05:04:01.948902 25182 raft_consensus.cc:348] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43325 } }
I20260808 05:04:01.949038 25182 raft_consensus.cc:374] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:01.949061 25182 raft_consensus.cc:729] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b32c7a6ab01e4d1187fe2e5ce23b47eb, State: Initialized, Role: FOLLOWER
I20260808 05:04:01.949157 25182 consensus_queue.cc:260] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43325 } }
I20260808 05:04:01.949203 25182 raft_consensus.cc:388] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:04:01.949222 25182 raft_consensus.cc:482] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:04:01.949257 25182 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:04:01.949744 25182 raft_consensus.cc:504] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43325 } }
I20260808 05:04:01.949834 25182 leader_election.cc:302] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b32c7a6ab01e4d1187fe2e5ce23b47eb; no voters:
I20260808 05:04:01.949949 25182 leader_election.cc:288] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:04:01.950032 25185 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:04:01.950230 25182 sys_catalog.cc:564] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:04:01.950234 25185 raft_consensus.cc:686] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [term 1 LEADER]: Becoming Leader. State: Replica: b32c7a6ab01e4d1187fe2e5ce23b47eb, State: Running, Role: LEADER
I20260808 05:04:01.950462 25185 consensus_queue.cc:237] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43325 } }
I20260808 05:04:01.950670 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 25073
I20260808 05:04:01.950767 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:04:01.951011 11547 external_mini_cluster.cc:1428] Setting key 2d3619f57f8ad16f74bc01020c0eba89
I20260808 05:04:01.951479 25188 sys_catalog.cc:455] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader b32c7a6ab01e4d1187fe2e5ce23b47eb. Latest consensus state: current_term: 1 leader_uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43325 } } }
I20260808 05:04:01.951570 25188 sys_catalog.cc:458] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [sys.catalog]: This master's current role is: LEADER
I20260808 05:04:01.951970 25186 sys_catalog.cc:455] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b32c7a6ab01e4d1187fe2e5ce23b47eb" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43325 } } }
I20260808 05:04:01.951970 25207 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:04:01.952659 25207 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:04:01.952890 25186 sys_catalog.cc:458] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb [sys.catalog]: This master's current role is: LEADER
I20260808 05:04:01.956651 25207 catalog_manager.cc:1347] Generated new cluster ID: 9b76689b3da9435292771e02731a40c1
I20260808 05:04:01.956712 25207 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:04:01.957262 25214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:01.951826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36270 (local address 127.11.70.254:43325)
0808 05:04:01.952024 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:01.952043 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:01.952188 (+ 145us) server_negotiation.cc:407] Connection header received
0808 05:04:01.952381 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:01.952389 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:01.952463 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:01.952613 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:01.952883 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.953988 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.955144 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:01.955574 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:01.955671 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:01.956413 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:01.956417 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:01.956418 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:04:01.956665 (+ 247us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:01.956714 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:04:01.956731 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:01.956799 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:01.956932 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 05:04:01.957021 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":68,"threads_started":1}
I20260808 05:04:01.961977 25207 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:04:01.962581 25207 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:04:01.978098 25207 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b32c7a6ab01e4d1187fe2e5ce23b47eb: Generated new TSK 0
I20260808 05:04:01.978317 25207 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:04:01.985678 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43325
--builtin_ntp_servers=127.11.70.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 05:04:02.069748 25217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:02.069943 25217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:02.069964 25217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:02.071215 25217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:02.071255 25217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:02.071280 25217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:04:02.072614 25217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:02.072875 25217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:02.073194 25217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:02.078487 25228 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:02.078531 25227 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:02.078817 25217 server_base.cc:1034] running on GCE node
W20260808 05:04:02.078495 25230 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:02.079126 25217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:02.079393 25217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:02.080606 25217 hybrid_clock.cc:648] HybridClock initialized: now 1786165442080586 us; error 39 us; skew 500 ppm
I20260808 05:04:02.081957 25217 webserver.cc:460] Webserver started at http://127.11.70.193:33157/ using document root <none> and password file <none>
I20260808 05:04:02.082233 25217 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:02.082283 25217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:02.082500 25217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:02.083613 25217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "cc46abca387c49c797083624876554a9"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "1c95ca6b12872af0fbb5b999d382d405"
server_key_iv: "7a9d08ef79a3fd334c21bc8f4f7aa5d2"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.083989 25217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "cc46abca387c49c797083624876554a9"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "1c95ca6b12872af0fbb5b999d382d405"
server_key_iv: "7a9d08ef79a3fd334c21bc8f4f7aa5d2"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.085427 25217 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:04:02.086249 25237 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.086432 25217 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:02.086565 25217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "cc46abca387c49c797083624876554a9"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "1c95ca6b12872af0fbb5b999d382d405"
server_key_iv: "7a9d08ef79a3fd334c21bc8f4f7aa5d2"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.086655 25217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:02.118119 25217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:02.118515 25217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:02.118688 25217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:02.118956 25217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:02.119330 25217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:02.119392 25217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.119441 25217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:02.119464 25217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.125696 25217 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:39173
I20260808 05:04:02.125751 25418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:39173 every 8 connection(s)
I20260808 05:04:02.126092 25217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:04:02.131518 25214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.126887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:44141 (local address 127.11.70.254:43325)
0808 05:04:02.126946 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:02.126948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:02.127242 (+ 294us) server_negotiation.cc:407] Connection header received
0808 05:04:02.127770 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:02.127771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:02.127785 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:02.127846 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:02.128605 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.129129 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.130122 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.130316 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.130374 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:02.131270 (+ 896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:02.131271 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:02.131271 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:04:02.131277 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:02.131290 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:04:02.131294 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:02.131342 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:02.131430 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 05:04:02.131456 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:04:02.131695 25423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.126881 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:43325 (local address 127.11.70.193:44141)
0808 05:04:02.127096 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:02.127133 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:02.127651 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:02.127929 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:02.127932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:02.127941 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:02.128471 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:02.128475 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.129227 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.129228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:02.130027 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:02.130030 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.130404 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.130405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:02.130572 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:02.131136 (+ 564us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:04:02.131137 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:02.131164 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:04:02.131186 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:02.131357 (+ 171us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:02.131362 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:02.131364 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:04:02.131416 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:04:02.131495 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":103,"threads_started":1}
I20260808 05:04:02.132036 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 25217
I20260808 05:04:02.132162 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:04:02.132228 25419 heartbeater.cc:347] Connected to a master server at 127.11.70.254:43325
I20260808 05:04:02.132332 25419 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:02.132400 11547 external_mini_cluster.cc:1428] Setting key 36bfe04138ad00dad19f93b3f9a8fe2f
I20260808 05:04:02.132536 25419 heartbeater.cc:511] Master 127.11.70.254:43325 requested a full tablet report, sending...
I20260808 05:04:02.133118 25121 ts_manager.cc:194] Registered new tserver with Master: cc46abca387c49c797083624876554a9 (127.11.70.193:39173)
I20260808 05:04:02.133467 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43325
--builtin_ntp_servers=127.11.70.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 05:04:02.134007 25121 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.193:44141
W20260808 05:04:02.220063 25424 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:02.220293 25424 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:02.220316 25424 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:02.221421 25424 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:02.221455 25424 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:02.221479 25424 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:04:02.222945 25424 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25424
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:02.223194 25424 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:02.223533 25424 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:02.228704 25433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:02.228654 25431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:02.228892 25424 server_base.cc:1034] running on GCE node
W20260808 05:04:02.229096 25436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:02.229379 25424 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:02.229589 25424 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:02.230762 25424 hybrid_clock.cc:648] HybridClock initialized: now 1786165442230746 us; error 26 us; skew 500 ppm
I20260808 05:04:02.232220 25424 webserver.cc:460] Webserver started at http://127.11.70.194:41737/ using document root <none> and password file <none>
I20260808 05:04:02.232465 25424 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:02.232544 25424 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:02.232730 25424 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:02.233784 25424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "0665c2fe3bc14cd2899a3e1f1192b303"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "e6816801bf502a6d25f14e7c1632f3f3"
server_key_iv: "90c15a6e258ab72ec0ea36f3b92ca5f9"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.234174 25424 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "0665c2fe3bc14cd2899a3e1f1192b303"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "e6816801bf502a6d25f14e7c1632f3f3"
server_key_iv: "90c15a6e258ab72ec0ea36f3b92ca5f9"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.235608 25424 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:04:02.236389 25445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.236567 25424 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:04:02.236681 25424 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "0665c2fe3bc14cd2899a3e1f1192b303"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "e6816801bf502a6d25f14e7c1632f3f3"
server_key_iv: "90c15a6e258ab72ec0ea36f3b92ca5f9"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.236769 25424 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:02.268137 25424 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:02.268491 25424 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:02.268685 25424 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:02.268963 25424 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:02.269322 25424 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:02.269383 25424 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.269420 25424 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:02.269475 25424 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.276082 25424 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:43339
I20260808 05:04:02.276125 25603 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:43339 every 8 connection(s)
I20260808 05:04:02.276489 25424 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:04:02.279860 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 25424
I20260808 05:04:02.279970 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:04:02.280179 11547 external_mini_cluster.cc:1428] Setting key ccab422b957a00470fdb64563c18d9d9
I20260808 05:04:02.281484 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43325
--builtin_ntp_servers=127.11.70.212:42185
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 05:04:02.282549 25214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.277286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:40049 (local address 127.11.70.254:43325)
0808 05:04:02.277362 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:02.277364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:02.277659 (+ 295us) server_negotiation.cc:407] Connection header received
0808 05:04:02.278164 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:02.278165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:02.278175 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:02.278224 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:02.278964 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.279448 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.280856 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.281160 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.281231 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:02.282186 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:02.282187 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:02.282187 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:04:02.282192 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:02.282206 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:04:02.282210 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:02.282301 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:02.282414 (+ 113us) server_negotiation.cc:299] Negotiation successful
0808 05:04:02.282442 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:04:02.282796 25607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.277261 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:43325 (local address 127.11.70.194:40049)
0808 05:04:02.277533 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:02.277569 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:02.278073 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:02.278286 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:02.278289 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:02.278297 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:02.278884 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:02.278890 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.279546 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.279547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:02.280774 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:02.280777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.281280 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.281282 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:02.281448 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:02.282014 (+ 566us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:04:02.282015 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:02.282052 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:04:02.282080 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:02.282304 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:02.282312 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:02.282316 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:04:02.282401 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 05:04:02.282526 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":111,"threads_started":1}
I20260808 05:04:02.283327 25604 heartbeater.cc:347] Connected to a master server at 127.11.70.254:43325
I20260808 05:04:02.283452 25604 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:02.283653 25604 heartbeater.cc:511] Master 127.11.70.254:43325 requested a full tablet report, sending...
I20260808 05:04:02.284049 25121 ts_manager.cc:194] Registered new tserver with Master: 0665c2fe3bc14cd2899a3e1f1192b303 (127.11.70.194:43339)
I20260808 05:04:02.284546 25121 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.194:40049
W20260808 05:04:02.367959 25608 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:02.368212 25608 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:02.368245 25608 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:02.369395 25608 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:02.369467 25608 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:02.369508 25608 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:04:02.370862 25608 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42185
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43325
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25608
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:02.371150 25608 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:02.371464 25608 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:02.376858 25618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:02.376876 25616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:02.376914 25608 server_base.cc:1034] running on GCE node
W20260808 05:04:02.376925 25620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:02.377319 25608 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:02.377583 25608 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:02.378809 25608 hybrid_clock.cc:648] HybridClock initialized: now 1786165442378801 us; error 42 us; skew 500 ppm
I20260808 05:04:02.380131 25608 webserver.cc:460] Webserver started at http://127.11.70.195:46551/ using document root <none> and password file <none>
I20260808 05:04:02.380486 25608 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:02.380563 25608 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:02.380722 25608 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:02.381758 25608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "2dd4abb2cccb40e28a7be4298a14163b"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "19c5d0f87f94c1c0ba6e526495e70a03"
server_key_iv: "36ac716d7f49131a69da46cc4ddd1b23"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.382139 25608 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "2dd4abb2cccb40e28a7be4298a14163b"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "19c5d0f87f94c1c0ba6e526495e70a03"
server_key_iv: "36ac716d7f49131a69da46cc4ddd1b23"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.383580 25608 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:04:02.384385 25631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.384627 25608 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:04:02.384745 25608 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "2dd4abb2cccb40e28a7be4298a14163b"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "19c5d0f87f94c1c0ba6e526495e70a03"
server_key_iv: "36ac716d7f49131a69da46cc4ddd1b23"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.384822 25608 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:02.412520 25608 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:02.412933 25608 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:02.413121 25608 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:02.413383 25608 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:02.413764 25608 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:02.413829 25608 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.413879 25608 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:02.413913 25608 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.420688 25608 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:36991
I20260808 05:04:02.420835 25799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:36991 every 8 connection(s)
I20260808 05:04:02.421171 25608 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:04:02.427040 25214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.422031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:48361 (local address 127.11.70.254:43325)
0808 05:04:02.422079 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:02.422082 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:02.422313 (+ 231us) server_negotiation.cc:407] Connection header received
0808 05:04:02.422982 (+ 669us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:02.422983 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:02.422996 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:02.423052 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:02.423799 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.424319 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.425320 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.425523 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.425609 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:02.426681 (+ 1072us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:02.426683 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:02.426683 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:04:02.426690 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:02.426716 (+ 26us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:04:02.426721 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:02.426797 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:02.426909 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 05:04:02.426946 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:04:02.427345 25802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.421984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:43325 (local address 127.11.70.195:48361)
0808 05:04:02.422179 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:02.422214 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:02.422867 (+ 653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:02.423121 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:02.423125 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:02.423136 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:02.423706 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:02.423712 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.424426 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.424427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:02.425219 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:02.425221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:02.425618 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:02.425619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:02.425768 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:02.426392 (+ 624us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:04:02.426392 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:02.426424 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:04:02.426449 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:02.426798 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:02.426807 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:02.426811 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:04:02.426911 (+ 100us) client_negotiation.cc:240] Negotiation successful
0808 05:04:02.427027 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
I20260808 05:04:02.427935 25800 heartbeater.cc:347] Connected to a master server at 127.11.70.254:43325
I20260808 05:04:02.428027 25800 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:02.428193 25800 heartbeater.cc:511] Master 127.11.70.254:43325 requested a full tablet report, sending...
I20260808 05:04:02.428570 25121 ts_manager.cc:194] Registered new tserver with Master: 2dd4abb2cccb40e28a7be4298a14163b (127.11.70.195:36991)
I20260808 05:04:02.428665 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 25608
I20260808 05:04:02.428798 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:04:02.428999 11547 external_mini_cluster.cc:1428] Setting key 33effad255beebea9044784ebfcd2029
I20260808 05:04:02.429132 25121 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.195:48361
I20260808 05:04:02.430016 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 05:04:02.432253 25214 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:04:02.431491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36278 (local address 127.11.70.254:43325)
0808 05:04:02.431567 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:02.431569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:02.431948 (+ 379us) server_negotiation.cc:407] Connection header received
0808 05:04:02.431971 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:02.431971 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:02.431983 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:02.432027 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:02.432183 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36278: BlockingRecv error: recv got EOF from 127.0.0.1:36278 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 05:04:02.432425 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 25217
I20260808 05:04:02.443588 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 25424
I20260808 05:04:02.457228 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 25608
I20260808 05:04:02.468523 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 25073
2026-08-08T05:04:02Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (694 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T05:04:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:04:02Z Disabled control of system clock
I20260808 05:04:02.500104 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:38081
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:38081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 05:04:02.583098 25814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:02.583313 25814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:02.583334 25814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:02.584589 25814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:04:02.584631 25814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:02.584645 25814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:02.584657 25814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:04:02.584671 25814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:04:02.586018 25814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:38081
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:38081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:02.586287 25814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:02.586647 25814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:02.591671 25823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:02.591714 25821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:02.592346 25820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:02.592357 25814 server_base.cc:1034] running on GCE node
I20260808 05:04:02.592680 25814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:02.592941 25814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:02.594130 25814 hybrid_clock.cc:648] HybridClock initialized: now 1786165442594116 us; error 33 us; skew 500 ppm
I20260808 05:04:02.595571 25814 webserver.cc:460] Webserver started at http://127.11.70.254:33461/ using document root <none> and password file <none>
I20260808 05:04:02.595906 25814 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:02.595959 25814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:02.596105 25814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:02.597191 25814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "30595714a3ca48cbb64d2200789c18af"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "d469752829b3c76e56f56f36bcb47f1b"
server_key_iv: "eec7617694412c47f0b7f7249307ba01"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.597564 25814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "30595714a3ca48cbb64d2200789c18af"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "d469752829b3c76e56f56f36bcb47f1b"
server_key_iv: "eec7617694412c47f0b7f7249307ba01"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.598978 25814 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:04:02.599843 25832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.600157 25814 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:02.600250 25814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "30595714a3ca48cbb64d2200789c18af"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "d469752829b3c76e56f56f36bcb47f1b"
server_key_iv: "eec7617694412c47f0b7f7249307ba01"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.600308 25814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:02.603806 25814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:02.604025 25814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:02.604127 25814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:02.608244 25814 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:38081
I20260808 05:04:02.608296 25901 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:38081 every 8 connection(s)
I20260808 05:04:02.608595 25814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:04:02.609472 25902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:02.612571 25902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af: Bootstrap starting.
I20260808 05:04:02.613230 25902 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:02.613570 25902 log.cc:824] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:02.614319 25902 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af: No bootstrap required, opened a new log
I20260808 05:04:02.614774 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 25814
I20260808 05:04:02.614858 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:04:02.615059 11547 external_mini_cluster.cc:1428] Setting key fe435f020399ed447cdf451c969e5531
I20260808 05:04:02.616510 25902 raft_consensus.cc:348] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30595714a3ca48cbb64d2200789c18af" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38081 } }
I20260808 05:04:02.616688 25902 raft_consensus.cc:374] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:02.616762 25902 raft_consensus.cc:729] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30595714a3ca48cbb64d2200789c18af, State: Initialized, Role: FOLLOWER
I20260808 05:04:02.616981 25902 consensus_queue.cc:260] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30595714a3ca48cbb64d2200789c18af" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38081 } }
I20260808 05:04:02.617098 25902 raft_consensus.cc:388] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:04:02.617141 25902 raft_consensus.cc:482] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:04:02.617230 25902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:04:02.617897 25907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.615628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39990 (local address 127.11.70.254:38081)
0808 05:04:02.615890 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:02.615897 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:02.615921 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:04:02.616491 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:02.616498 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:02.616537 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:02.616683 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:02.617457 (+ 774us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:02.617461 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:02.617461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:04:02.617465 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:02.617513 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:04:02.617525 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:02.617602 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:02.617678 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 05:04:02.617737 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":111,"threads_started":1}
I20260808 05:04:02.617913 25902 raft_consensus.cc:504] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30595714a3ca48cbb64d2200789c18af" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38081 } }
I20260808 05:04:02.618084 25902 leader_election.cc:302] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 30595714a3ca48cbb64d2200789c18af; no voters:
I20260808 05:04:02.618260 25902 leader_election.cc:288] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:04:02.618574 25902 sys_catalog.cc:564] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:04:02.618630 25908 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:04:02.618824 25908 raft_consensus.cc:686] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [term 1 LEADER]: Becoming Leader. State: Replica: 30595714a3ca48cbb64d2200789c18af, State: Running, Role: LEADER
I20260808 05:04:02.618983 25908 consensus_queue.cc:237] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30595714a3ca48cbb64d2200789c18af" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38081 } }
I20260808 05:04:02.619488 25911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 30595714a3ca48cbb64d2200789c18af. Latest consensus state: current_term: 1 leader_uuid: "30595714a3ca48cbb64d2200789c18af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30595714a3ca48cbb64d2200789c18af" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38081 } } }
I20260808 05:04:02.619596 25909 sys_catalog.cc:455] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "30595714a3ca48cbb64d2200789c18af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "30595714a3ca48cbb64d2200789c18af" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38081 } } }
I20260808 05:04:02.619670 25911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [sys.catalog]: This master's current role is: LEADER
I20260808 05:04:02.619697 25909 sys_catalog.cc:458] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af [sys.catalog]: This master's current role is: LEADER
I20260808 05:04:02.620092 25928 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:04:02.620663 25928 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:04:02.622327 25928 catalog_manager.cc:1347] Generated new cluster ID: 7b88e445454a424fa9a9e94d26fb51c2
I20260808 05:04:02.622386 25928 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:04:02.644052 25928 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:04:02.644228 25928 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:04:02.650035 25928 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 30595714a3ca48cbb64d2200789c18af: Generated new TSK 0
I20260808 05:04:02.650264 25928 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:04:02.654187 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38081
--builtin_ntp_servers=127.11.70.212:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 05:04:02.751739 25939 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:02.751974 25939 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:02.752012 25939 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:02.753162 25939 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:02.753229 25939 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:02.753273 25939 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:04:02.754698 25939 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25939
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:02.754946 25939 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:02.755247 25939 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:02.762238 25948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:02.762245 25950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:02.762246 25946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:02.762379 25939 server_base.cc:1034] running on GCE node
I20260808 05:04:02.762734 25939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:02.762995 25939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:02.764179 25939 hybrid_clock.cc:648] HybridClock initialized: now 1786165442764164 us; error 33 us; skew 500 ppm
I20260808 05:04:02.765533 25939 webserver.cc:460] Webserver started at http://127.11.70.193:40073/ using document root <none> and password file <none>
I20260808 05:04:02.765944 25939 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:02.766058 25939 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:02.766237 25939 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:02.767445 25939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "e798675bb48e4fee9fc04b8088eb740b"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "93649505ce1f9bb6dc24a69dce0bafed"
server_key_iv: "eb88b6a05ad27468a56cf73482bd7cdc"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.767849 25939 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "e798675bb48e4fee9fc04b8088eb740b"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "93649505ce1f9bb6dc24a69dce0bafed"
server_key_iv: "eb88b6a05ad27468a56cf73482bd7cdc"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.769235 25939 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:04:02.770023 25957 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.770227 25939 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:04:02.770335 25939 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "e798675bb48e4fee9fc04b8088eb740b"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "93649505ce1f9bb6dc24a69dce0bafed"
server_key_iv: "eb88b6a05ad27468a56cf73482bd7cdc"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.770406 25939 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:02.775034 25939 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:02.775341 25939 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:02.775472 25939 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:02.775707 25939 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:02.776041 25939 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:02.776082 25939 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.776110 25939 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:02.776146 25939 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.783573 25939 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:40053
I20260808 05:04:02.783603 26124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:40053 every 8 connection(s)
I20260808 05:04:02.784001 25939 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:04:02.787326 25907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.785104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:55397 (local address 127.11.70.254:38081)
0808 05:04:02.785160 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:02.785163 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:02.785205 (+ 42us) server_negotiation.cc:407] Connection header received
0808 05:04:02.785661 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:02.785662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:02.785668 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:02.785732 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:02.787033 (+ 1301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:02.787034 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:02.787035 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:04:02.787040 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:02.787059 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:04:02.787064 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:02.787134 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:02.787214 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 05:04:02.787229 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 05:04:02.787484 26127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.784856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38081 (local address 127.11.70.193:55397)
0808 05:04:02.785078 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:02.785112 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:02.785549 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:02.785805 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:02.785808 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:02.785817 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:02.786880 (+ 1063us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:04:02.786881 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:02.786910 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:04:02.786938 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:02.787132 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:02.787137 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:02.787139 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:04:02.787204 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:04:02.787271 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":97,"threads_started":1}
I20260808 05:04:02.788026 26125 heartbeater.cc:347] Connected to a master server at 127.11.70.254:38081
I20260808 05:04:02.788132 26125 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:02.788287 26125 heartbeater.cc:511] Master 127.11.70.254:38081 requested a full tablet report, sending...
I20260808 05:04:02.788813 25856 ts_manager.cc:194] Registered new tserver with Master: e798675bb48e4fee9fc04b8088eb740b (127.11.70.193:40053)
I20260808 05:04:02.790256 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 25939
I20260808 05:04:02.790367 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:04:02.790681 11547 external_mini_cluster.cc:1428] Setting key b94ebf2fe435b19cf60e8cb7e42185c7
I20260808 05:04:02.791679 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38081
--builtin_ntp_servers=127.11.70.212:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 05:04:02.875941 26128 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:02.876161 26128 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:02.876186 26128 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:02.877422 26128 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:02.877465 26128 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:02.877490 26128 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:04:02.878934 26128 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26128
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:02.879196 26128 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:02.879495 26128 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:02.884899 26136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:02.884918 26135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:02.884899 26138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:02.885196 26128 server_base.cc:1034] running on GCE node
I20260808 05:04:02.885428 26128 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:02.885632 26128 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:02.886780 26128 hybrid_clock.cc:648] HybridClock initialized: now 1786165442886766 us; error 27 us; skew 500 ppm
I20260808 05:04:02.888162 26128 webserver.cc:460] Webserver started at http://127.11.70.194:35877/ using document root <none> and password file <none>
I20260808 05:04:02.888427 26128 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:02.888478 26128 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:02.888666 26128 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:02.889835 26128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "eefc76ca5ac444ed8006d07a87d38727"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "84ad65aa6279fa805603a003014f177d"
server_key_iv: "92cd6495fcdfc466f2e4cf87cbe3d488"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.890213 26128 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "eefc76ca5ac444ed8006d07a87d38727"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "84ad65aa6279fa805603a003014f177d"
server_key_iv: "92cd6495fcdfc466f2e4cf87cbe3d488"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.891788 26128 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:04:02.892550 26152 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.892768 26128 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:02.892858 26128 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "eefc76ca5ac444ed8006d07a87d38727"
format_stamp: "Formatted at 2026-08-08 05:04:02 on dist-test-slave-7kzw"
server_key: "84ad65aa6279fa805603a003014f177d"
server_key_iv: "92cd6495fcdfc466f2e4cf87cbe3d488"
server_key_version: "encryptionkey@0"
I20260808 05:04:02.892912 26128 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:02.896770 26128 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:02.896998 26128 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:02.897099 26128 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:02.897342 26128 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:02.897624 26128 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:02.897655 26128 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.897722 26128 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:02.897742 26128 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:02.903621 26128 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:40209
I20260808 05:04:02.903736 26319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:40209 every 8 connection(s)
I20260808 05:04:02.904062 26128 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:04:02.907582 25907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.904955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:59941 (local address 127.11.70.254:38081)
0808 05:04:02.905025 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:02.905027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:02.905273 (+ 246us) server_negotiation.cc:407] Connection header received
0808 05:04:02.905766 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:02.905767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:02.905772 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:02.905835 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:02.907200 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:02.907201 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:02.907201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:04:02.907205 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:02.907223 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:04:02.907228 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:02.907301 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:02.907470 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 05:04:02.907488 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:04:02.907586 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 26128
I20260808 05:04:02.907691 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:04:02.907840 26322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:02.904910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38081 (local address 127.11.70.194:59941)
0808 05:04:02.905127 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:02.905172 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:02.905678 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:02.905891 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:02.905895 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:02.905903 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:02.906995 (+ 1092us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:04:02.906996 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:02.907028 (+ 32us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:04:02.907078 (+ 50us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:02.907347 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:02.907354 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:02.907357 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:04:02.907441 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:04:02.907495 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":105,"threads_started":1}
I20260808 05:04:02.907956 11547 external_mini_cluster.cc:1428] Setting key ae874f804853d0aa7c298a292b653d57
I20260808 05:04:02.908371 26320 heartbeater.cc:347] Connected to a master server at 127.11.70.254:38081
I20260808 05:04:02.908493 26320 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:02.908654 26320 heartbeater.cc:511] Master 127.11.70.254:38081 requested a full tablet report, sending...
I20260808 05:04:02.908900 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38081
--builtin_ntp_servers=127.11.70.212:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260808 05:04:02.909056 25856 ts_manager.cc:194] Registered new tserver with Master: eefc76ca5ac444ed8006d07a87d38727 (127.11.70.194:40209)
W20260808 05:04:02.991834 26323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:02.992033 26323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:02.992055 26323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:02.993146 26323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:02.993180 26323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:02.993204 26323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:04:02.994455 26323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:38081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:02.994660 26323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:02.994896 26323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:03.000448 26328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:03.000594 26323 server_base.cc:1034] running on GCE node
W20260808 05:04:03.000641 26333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:03.000425 26329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:03.000943 26323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:03.001215 26323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:03.002368 26323 hybrid_clock.cc:648] HybridClock initialized: now 1786165443002354 us; error 29 us; skew 500 ppm
I20260808 05:04:03.003849 26323 webserver.cc:460] Webserver started at http://127.11.70.195:45997/ using document root <none> and password file <none>
I20260808 05:04:03.004117 26323 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:03.004166 26323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:03.004302 26323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:03.005425 26323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "4a817c79eb1b49149f4de0deb18c2d64"
format_stamp: "Formatted at 2026-08-08 05:04:03 on dist-test-slave-7kzw"
server_key: "1d439df26fe40c43f5f89ce31e3d7aef"
server_key_iv: "714371d26fec8da64827151d9f002b0c"
server_key_version: "encryptionkey@0"
I20260808 05:04:03.005795 26323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "4a817c79eb1b49149f4de0deb18c2d64"
format_stamp: "Formatted at 2026-08-08 05:04:03 on dist-test-slave-7kzw"
server_key: "1d439df26fe40c43f5f89ce31e3d7aef"
server_key_iv: "714371d26fec8da64827151d9f002b0c"
server_key_version: "encryptionkey@0"
I20260808 05:04:03.007458 26323 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:04:03.008347 26342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:03.008698 26323 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:03.008797 26323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "4a817c79eb1b49149f4de0deb18c2d64"
format_stamp: "Formatted at 2026-08-08 05:04:03 on dist-test-slave-7kzw"
server_key: "1d439df26fe40c43f5f89ce31e3d7aef"
server_key_iv: "714371d26fec8da64827151d9f002b0c"
server_key_version: "encryptionkey@0"
I20260808 05:04:03.008854 26323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:03.012234 26323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:03.012450 26323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:03.012548 26323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:03.012718 26323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:03.013039 26323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:03.013075 26323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:03.013098 26323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:03.013150 26323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:03.019034 26323 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:32785
I20260808 05:04:03.019107 26500 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:32785 every 8 connection(s)
I20260808 05:04:03.019465 26323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:04:03.022622 25907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:03.020331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:40543 (local address 127.11.70.254:38081)
0808 05:04:03.020410 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:03.020412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:03.020647 (+ 235us) server_negotiation.cc:407] Connection header received
0808 05:04:03.021125 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:03.021126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:03.021136 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:03.021188 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:03.022326 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:03.022327 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:03.022327 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:04:03.022332 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:03.022347 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:04:03.022351 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:03.022405 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:03.022526 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 05:04:03.022544 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:04:03.022799 26504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:03.020292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:38081 (local address 127.11.70.195:40543)
0808 05:04:03.020522 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:03.020555 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:03.021025 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:03.021248 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:03.021252 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:03.021260 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:03.022174 (+ 914us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:04:03.022174 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:03.022201 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:04:03.022231 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:03.022401 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:03.022403 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:03.022405 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:04:03.022455 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:04:03.022564 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":118,"threads_started":1}
I20260808 05:04:03.023327 26501 heartbeater.cc:347] Connected to a master server at 127.11.70.254:38081
I20260808 05:04:03.023407 26501 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:03.023581 26501 heartbeater.cc:511] Master 127.11.70.254:38081 requested a full tablet report, sending...
I20260808 05:04:03.024005 25856 ts_manager.cc:194] Registered new tserver with Master: 4a817c79eb1b49149f4de0deb18c2d64 (127.11.70.195:32785)
I20260808 05:04:03.024513 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 26323
I20260808 05:04:03.024632 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:04:03.024883 11547 external_mini_cluster.cc:1428] Setting key 3769b7d845ce2669dfd2b6c9341750c5
I20260808 05:04:03.025985 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 05:04:03.028210 25907 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:04:03.027507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40006 (local address 127.11.70.254:38081)
0808 05:04:03.027601 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:03.027603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:03.027849 (+ 246us) server_negotiation.cc:407] Connection header received
0808 05:04:03.027879 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:03.027880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:03.027887 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:03.027945 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:03.028136 (+ 191us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40006: BlockingRecv error: recv got EOF from 127.0.0.1:40006 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 05:04:03.028292 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 25939
I20260808 05:04:03.043467 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 26128
I20260808 05:04:03.056316 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 26323
I20260808 05:04:03.066143 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 25814
2026-08-08T05:04:03Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (597 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:04:03 dist-test-slave-7kzw krb5kdc[26513](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:04:03 dist-test-slave-7kzw krb5kdc[26513](info): set up 2 sockets
Aug 08 05:04:03 dist-test-slave-7kzw krb5kdc[26513](info): commencing operation
krb5kdc: starting...
W20260808 05:04:04.300786 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:04:04 dist-test-slave-7kzw krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:04:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:04:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:04:04.423144 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:36923
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:36899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:36923
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:04:04.508800 26539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:04.509003 26539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:04.509025 26539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:04.510345 26539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:04:04.510392 26539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:04.510411 26539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:04.510423 26539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:04:04.510435 26539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:04:04.512085 26539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:36899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:36923
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:36923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:04.512346 26539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:04.512600 26539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:04:04.517793 26539 server_base.cc:1034] running on GCE node
W20260808 05:04:04.517760 26547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:04.517776 26550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:04.517748 26548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:04.518298 26539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:04.518658 26539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:04.519819 26539 hybrid_clock.cc:648] HybridClock initialized: now 1786165444519789 us; error 46 us; skew 500 ppm
Aug 08 05:04:04 dist-test-slave-7kzw krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165444, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:04:04.522660 26539 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:04:04.523126 26539 webserver.cc:460] Webserver started at http://127.11.70.254:46597/ using document root <none> and password file <none>
I20260808 05:04:04.523412 26539 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:04.523491 26539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:04.523664 26539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:04.524811 26539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "ceeee7d0921e40199aa1fdd3783f4dd4"
format_stamp: "Formatted at 2026-08-08 05:04:04 on dist-test-slave-7kzw"
server_key: "3311e03d71f8fd86fd30dd358866e9b2"
server_key_iv: "d112183a078c323908b622bd65180f5e"
server_key_version: "encryptionkey@0"
I20260808 05:04:04.525215 26539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "ceeee7d0921e40199aa1fdd3783f4dd4"
format_stamp: "Formatted at 2026-08-08 05:04:04 on dist-test-slave-7kzw"
server_key: "3311e03d71f8fd86fd30dd358866e9b2"
server_key_iv: "d112183a078c323908b622bd65180f5e"
server_key_version: "encryptionkey@0"
I20260808 05:04:04.526742 26539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:04:04.527637 26559 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:04.527943 26539 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:04.528055 26539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "ceeee7d0921e40199aa1fdd3783f4dd4"
format_stamp: "Formatted at 2026-08-08 05:04:04 on dist-test-slave-7kzw"
server_key: "3311e03d71f8fd86fd30dd358866e9b2"
server_key_iv: "d112183a078c323908b622bd65180f5e"
server_key_version: "encryptionkey@0"
I20260808 05:04:04.528139 26539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:04.548923 26539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:04.551054 26539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:04.551219 26539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:04.555816 26539 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:36923
I20260808 05:04:04.555877 26630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:36923 every 8 connection(s)
I20260808 05:04:04.556252 26539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:04:04.557293 26631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:04.558753 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 26539
I20260808 05:04:04.558874 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:04:04.559067 11547 external_mini_cluster.cc:1428] Setting key 193bca175bd2d7acd71af71fa24cc398
I20260808 05:04:04.560202 26631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4: Bootstrap starting.
I20260808 05:04:04.560935 26631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:04.561247 26631 log.cc:824] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:04.562040 26631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4: No bootstrap required, opened a new log
I20260808 05:04:04.564311 26631 raft_consensus.cc:348] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeee7d0921e40199aa1fdd3783f4dd4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36923 } }
I20260808 05:04:04.564640 26631 raft_consensus.cc:374] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:04.564687 26631 raft_consensus.cc:729] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ceeee7d0921e40199aa1fdd3783f4dd4, State: Initialized, Role: FOLLOWER
I20260808 05:04:04.564841 26631 consensus_queue.cc:260] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeee7d0921e40199aa1fdd3783f4dd4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36923 } }
I20260808 05:04:04.564936 26631 raft_consensus.cc:388] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:04:04.564960 26631 raft_consensus.cc:482] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:04:04.564987 26631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:04:04.565558 26631 raft_consensus.cc:504] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeee7d0921e40199aa1fdd3783f4dd4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36923 } }
I20260808 05:04:04.565687 26631 leader_election.cc:302] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ceeee7d0921e40199aa1fdd3783f4dd4; no voters:
I20260808 05:04:04.565811 26631 leader_election.cc:288] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:04:04.565891 26638 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:04:04.566097 26638 raft_consensus.cc:686] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [term 1 LEADER]: Becoming Leader. State: Replica: ceeee7d0921e40199aa1fdd3783f4dd4, State: Running, Role: LEADER
I20260808 05:04:04.566104 26631 sys_catalog.cc:564] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:04:04.566205 26638 consensus_queue.cc:237] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeee7d0921e40199aa1fdd3783f4dd4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36923 } }
I20260808 05:04:04.566728 26642 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ceeee7d0921e40199aa1fdd3783f4dd4. Latest consensus state: current_term: 1 leader_uuid: "ceeee7d0921e40199aa1fdd3783f4dd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeee7d0921e40199aa1fdd3783f4dd4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36923 } } }
I20260808 05:04:04.566721 26639 sys_catalog.cc:455] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ceeee7d0921e40199aa1fdd3783f4dd4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ceeee7d0921e40199aa1fdd3783f4dd4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 36923 } } }
I20260808 05:04:04.566847 26642 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:04:04.566850 26639 sys_catalog.cc:458] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:04:04.567116 26652 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:04:04.567868 26652 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:04:04.569351 26652 catalog_manager.cc:1347] Generated new cluster ID: 6dd16ee3258e48b69335cc5d2141aed9
I20260808 05:04:04.569412 26652 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:04:04 dist-test-slave-7kzw krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165444, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:04:04.575903 26634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:04.559645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45792 (local address 127.11.70.254:36923)
0808 05:04:04.559844 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:04.559854 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:04.559888 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:04:04.560457 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:04.560466 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:04.560531 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:04.560691 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:04.561343 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.562697 (+ 1354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.563414 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.564106 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.564224 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:04.572051 (+ 7827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:04.572055 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:04.572055 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:04.572068 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:04.574135 (+ 2067us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:04.574535 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:04.574538 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:04.574538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:04.574651 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:04.574874 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:04.574875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:04.574875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:04.575241 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:04.575448 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:04.575528 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 05:04:04.575695 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":85,"threads_started":1}
I20260808 05:04:04.599035 26652 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:04:04.599835 26652 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:04:04.606022 26652 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4: Generated new TSK 0
I20260808 05:04:04.606226 26652 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:04:04.641713 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36923
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:36899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:04:04.749470 26669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:04.749691 26669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:04.749717 26669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:04.751039 26669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:04.751092 26669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:04.751122 26669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:04:04.752722 26669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:36899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:04.753104 26669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:04.753388 26669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:04.758831 26675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:04.758858 26674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:04.758855 26677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:04.758996 26669 server_base.cc:1034] running on GCE node
I20260808 05:04:04.759188 26669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:04.759445 26669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:04.760608 26669 hybrid_clock.cc:648] HybridClock initialized: now 1786165444760585 us; error 51 us; skew 500 ppm
Aug 08 05:04:04 dist-test-slave-7kzw krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165444, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:04:04.763316 26669 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:04:04.763863 26669 webserver.cc:460] Webserver started at http://127.11.70.193:34279/ using document root <none> and password file <none>
I20260808 05:04:04.764122 26669 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:04.764199 26669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:04.764367 26669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:04.765511 26669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "2756e2adda884088a7b1d2af969886bb"
format_stamp: "Formatted at 2026-08-08 05:04:04 on dist-test-slave-7kzw"
server_key: "4ab551e524cbf5314a1ff784c6856603"
server_key_iv: "af69ed01bc55259d997ba3122fc22ae8"
server_key_version: "encryptionkey@0"
I20260808 05:04:04.765985 26669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "2756e2adda884088a7b1d2af969886bb"
format_stamp: "Formatted at 2026-08-08 05:04:04 on dist-test-slave-7kzw"
server_key: "4ab551e524cbf5314a1ff784c6856603"
server_key_iv: "af69ed01bc55259d997ba3122fc22ae8"
server_key_version: "encryptionkey@0"
I20260808 05:04:04.768071 26669 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 05:04:04.768980 26684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:04.769239 26669 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:04.769356 26669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "2756e2adda884088a7b1d2af969886bb"
format_stamp: "Formatted at 2026-08-08 05:04:04 on dist-test-slave-7kzw"
server_key: "4ab551e524cbf5314a1ff784c6856603"
server_key_iv: "af69ed01bc55259d997ba3122fc22ae8"
server_key_version: "encryptionkey@0"
I20260808 05:04:04.769454 26669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:04.789887 26669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:04.792141 26669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:04.792320 26669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:04.792577 26669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:04.792924 26669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:04.792985 26669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:04.793037 26669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:04.793082 26669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:04.799948 26669 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:42961
I20260808 05:04:04.799999 26855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:42961 every 8 connection(s)
I20260808 05:04:04.800359 26669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:04:04 dist-test-slave-7kzw krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165444, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:04:04.808429 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 26669
I20260808 05:04:04.808621 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:04:04.808871 11547 external_mini_cluster.cc:1428] Setting key 609f7bcf0ee1df1b6035ddaeecaf4c29
I20260808 05:04:04.810148 26634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:04.801097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:34775 (local address 127.11.70.254:36923)
0808 05:04:04.801171 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:04.801173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:04.801402 (+ 229us) server_negotiation.cc:407] Connection header received
0808 05:04:04.801946 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:04.801947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:04.801961 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:04.802016 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:04.803007 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.803520 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.804538 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.804777 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.804858 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:04.807178 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:04.807179 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:04.807180 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:04.807188 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:04.808545 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:04.809087 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:04.809088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:04.809089 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:04.809162 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:04.809444 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:04.809445 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:04.809446 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:04.809584 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:04.809658 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:04.810008 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 05:04:04.810082 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:04:04.810493 26858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:04.801062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:36923 (local address 127.11.70.193:34775)
0808 05:04:04.801273 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:04.801310 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:04.801836 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:04.802091 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:04.802095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:04.802701 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:04.802897 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:04.802902 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.803624 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.803626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:04.804437 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:04.804439 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.804868 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.804869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:04.805026 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:04.805517 (+ 491us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:04.805525 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:04.807076 (+ 1551us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:04.808655 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:04.808664 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:04.808667 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:04.808993 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:04.809234 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:04.809235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:04.809235 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:04.809368 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:04.809666 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:04.809674 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:04.809849 (+ 175us) client_negotiation.cc:769] Sending connection context
0808 05:04:04.809974 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 05:04:04.810167 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":101,"threads_started":1}
I20260808 05:04:04.811054 26856 heartbeater.cc:347] Connected to a master server at 127.11.70.254:36923
I20260808 05:04:04.811151 26856 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:04.811360 26856 heartbeater.cc:511] Master 127.11.70.254:36923 requested a full tablet report, sending...
I20260808 05:04:04.811908 26580 ts_manager.cc:194] Registered new tserver with Master: 2756e2adda884088a7b1d2af969886bb (127.11.70.193:42961)
I20260808 05:04:04.812523 26580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:34775
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:04:04.835718 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36923
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:36899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:04:04.917852 26861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:04.918058 26861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:04.918081 26861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:04.919292 26861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:04.919338 26861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:04.919364 26861 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:04:04.920836 26861 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:36899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:04.921092 26861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:04.921324 26861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:04.926436 26869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:04.926407 26874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:04.926497 26872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:04.926887 26861 server_base.cc:1034] running on GCE node
I20260808 05:04:04.927098 26861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:04.927358 26861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:04.928526 26861 hybrid_clock.cc:648] HybridClock initialized: now 1786165444928529 us; error 46 us; skew 500 ppm
Aug 08 05:04:04 dist-test-slave-7kzw krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165444, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:04:04.931314 26861 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:04:04.931835 26861 webserver.cc:460] Webserver started at http://127.11.70.194:32769/ using document root <none> and password file <none>
I20260808 05:04:04.932096 26861 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:04.932166 26861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:04.932317 26861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:04.933372 26861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3"
format_stamp: "Formatted at 2026-08-08 05:04:04 on dist-test-slave-7kzw"
server_key: "ac54acf7f2e772bbec7db4c385aa4ef7"
server_key_iv: "bc408f35242d5748be78d8935f613823"
server_key_version: "encryptionkey@0"
I20260808 05:04:04.933741 26861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3"
format_stamp: "Formatted at 2026-08-08 05:04:04 on dist-test-slave-7kzw"
server_key: "ac54acf7f2e772bbec7db4c385aa4ef7"
server_key_iv: "bc408f35242d5748be78d8935f613823"
server_key_version: "encryptionkey@0"
I20260808 05:04:04.935194 26861 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:04:04.935933 26882 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:04.936115 26861 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:04:04.936221 26861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3"
format_stamp: "Formatted at 2026-08-08 05:04:04 on dist-test-slave-7kzw"
server_key: "ac54acf7f2e772bbec7db4c385aa4ef7"
server_key_iv: "bc408f35242d5748be78d8935f613823"
server_key_version: "encryptionkey@0"
I20260808 05:04:04.936296 26861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:04.944422 26861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:04.946537 26861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:04.946692 26861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:04.946918 26861 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:04.947227 26861 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:04.947273 26861 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:04.947327 26861 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:04.947362 26861 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:04.953559 26861 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:45003
I20260808 05:04:04.953613 27033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:45003 every 8 connection(s)
I20260808 05:04:04.953950 26861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:04:04 dist-test-slave-7kzw krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165444, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:04:04.960736 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 26861
I20260808 05:04:04.960819 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:04:04.961018 11547 external_mini_cluster.cc:1428] Setting key 867e86ddd8cd5891c6579ee9af8064dd
I20260808 05:04:04.963140 26634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:04.954676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:57627 (local address 127.11.70.254:36923)
0808 05:04:04.954723 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:04.954725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:04.954975 (+ 250us) server_negotiation.cc:407] Connection header received
0808 05:04:04.955428 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:04.955430 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:04.955441 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:04.955495 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:04.956423 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.956918 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.957855 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.958045 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.958107 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:04.960173 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:04.960175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:04.960175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:04.960182 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:04.961710 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:04.962135 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:04.962136 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:04.962136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:04.962203 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:04.962459 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:04.962460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:04.962460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:04.962604 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:04.962685 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:04.962954 (+ 269us) server_negotiation.cc:299] Negotiation successful
0808 05:04:04.963034 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:04:04.963327 27037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:04.954660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:36923 (local address 127.11.70.194:57627)
0808 05:04:04.954821 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:04.954857 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:04.955338 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:04.955544 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:04.955547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:04.956116 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:04.956309 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:04.956314 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.957009 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.957009 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:04.957773 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:04.957774 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:04.958122 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:04.958123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:04.958226 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:04.958683 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:04.958691 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:04.960068 (+ 1377us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:04.961817 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:04.961825 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:04.961827 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:04.962054 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:04.962273 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:04.962274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:04.962274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:04.962387 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:04.962676 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:04.962684 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:04.962822 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 05:04:04.962929 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 05:04:04.963084 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":97,"threads_started":1}
I20260808 05:04:04.963860 27035 heartbeater.cc:347] Connected to a master server at 127.11.70.254:36923
I20260808 05:04:04.963976 27035 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:04.964166 27035 heartbeater.cc:511] Master 127.11.70.254:36923 requested a full tablet report, sending...
I20260808 05:04:04.964592 26580 ts_manager.cc:194] Registered new tserver with Master: 6c1932dc85804801ac0c7ac8fb7fe8b3 (127.11.70.194:45003)
I20260808 05:04:04.964968 26580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:57627
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:04:04.987592 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36923
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:36899
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:04:05.076056 27040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:05.076272 27040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:05.076296 27040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:05.077417 27040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:05.077457 27040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:05.077483 27040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:04:05.078956 27040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:36899
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:36923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:05.079151 27040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:05.079325 27040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:05.084470 27049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:05.084595 27040 server_base.cc:1034] running on GCE node
W20260808 05:04:05.084476 27048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:05.084678 27053 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:05.084913 27040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:05.085175 27040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:05.086351 27040 hybrid_clock.cc:648] HybridClock initialized: now 1786165445086336 us; error 26 us; skew 500 ppm
Aug 08 05:04:05 dist-test-slave-7kzw krb5kdc[26513](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165445, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:04:05.088941 27040 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:04:05.089424 27040 webserver.cc:460] Webserver started at http://127.11.70.195:32939/ using document root <none> and password file <none>
I20260808 05:04:05.089660 27040 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:05.089740 27040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:05.089905 27040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:04:05.091017 27040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "fbccaf7fc2d2483db886e0a66b884ae1"
format_stamp: "Formatted at 2026-08-08 05:04:05 on dist-test-slave-7kzw"
server_key: "3232cff1d4c0b9b1a3722851949d0b68"
server_key_iv: "69848fb7234ec48fa147cef2917fdd2a"
server_key_version: "encryptionkey@0"
I20260808 05:04:05.091480 27040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "fbccaf7fc2d2483db886e0a66b884ae1"
format_stamp: "Formatted at 2026-08-08 05:04:05 on dist-test-slave-7kzw"
server_key: "3232cff1d4c0b9b1a3722851949d0b68"
server_key_iv: "69848fb7234ec48fa147cef2917fdd2a"
server_key_version: "encryptionkey@0"
I20260808 05:04:05.092926 27040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:04:05.093719 27062 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:05.093904 27040 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:05.094017 27040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "fbccaf7fc2d2483db886e0a66b884ae1"
format_stamp: "Formatted at 2026-08-08 05:04:05 on dist-test-slave-7kzw"
server_key: "3232cff1d4c0b9b1a3722851949d0b68"
server_key_iv: "69848fb7234ec48fa147cef2917fdd2a"
server_key_version: "encryptionkey@0"
I20260808 05:04:05.094098 27040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:05.108069 27040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:05.110025 27040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:05.110198 27040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:05.110440 27040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:05.110924 27040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:05.110991 27040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:05.111037 27040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:05.111064 27040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:05.117169 27040 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:45543
I20260808 05:04:05.117216 27228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:45543 every 8 connection(s)
I20260808 05:04:05.117550 27040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:04:05.123090 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 27040
I20260808 05:04:05.123193 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:04:05.123401 11547 external_mini_cluster.cc:1428] Setting key 1818e5dbfeea939b8958027bbeb72142
Aug 08 05:04:05 dist-test-slave-7kzw krb5kdc[26513](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165445, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:04:05.126768 26634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.118290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:46345 (local address 127.11.70.254:36923)
0808 05:04:05.118348 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:05.118350 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:05.118603 (+ 253us) server_negotiation.cc:407] Connection header received
0808 05:04:05.119147 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:05.119148 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:05.119163 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:05.119222 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:05.120174 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.120683 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.121639 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.121824 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.121873 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.124335 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:05.124336 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:05.124336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:05.124343 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:05.125542 (+ 1199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:05.125912 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:05.125913 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:05.125913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:05.125969 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:05.126185 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:05.126185 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:05.126186 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:05.126294 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:05.126347 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:05.126638 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 05:04:05.126701 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:04:05.126966 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.118258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:36923 (local address 127.11.70.195:46345)
0808 05:04:05.118436 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:05.118515 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:05.119034 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:05.119309 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:05.119313 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:05.119900 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:05.120089 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.120093 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.120768 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.120768 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.121566 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.121568 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.121896 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.121896 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.121993 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.122445 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:05.122454 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:05.124255 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:05.125613 (+ 1358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:05.125619 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:05.125621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:05.125843 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:05.126030 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:05.126031 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:05.126031 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:05.126129 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:05.126353 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:05.126357 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:05.126521 (+ 164us) client_negotiation.cc:769] Sending connection context
0808 05:04:05.126624 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 05:04:05.126752 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":91,"threads_started":1}
I20260808 05:04:05.127431 27229 heartbeater.cc:347] Connected to a master server at 127.11.70.254:36923
I20260808 05:04:05.127525 27229 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:05.127672 27229 heartbeater.cc:511] Master 127.11.70.254:36923 requested a full tablet report, sending...
I20260808 05:04:05.128017 26580 ts_manager.cc:194] Registered new tserver with Master: fbccaf7fc2d2483db886e0a66b884ae1 (127.11.70.195:45543)
I20260808 05:04:05.128391 26580 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:46345
I20260808 05:04:05.135082 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:04:05.142541 26634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.136439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45794 (local address 127.11.70.254:36923)
0808 05:04:05.136485 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:05.136487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:05.136571 (+ 84us) server_negotiation.cc:407] Connection header received
0808 05:04:05.136623 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:05.136624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:05.136632 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:05.136682 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:05.137225 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.137723 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.138402 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.138618 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.138677 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.139956 (+ 1279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:05.139957 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:05.139958 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:05.139964 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:05.141386 (+ 1422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:05.141810 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:05.141811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:05.141811 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:05.141872 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:05.142044 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:05.142045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:05.142045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:05.142183 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:05.142263 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:05.142356 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 05:04:05.142413 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:04:05.144135 26580 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45794:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:04:05.145774 26580 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:04:05.152801 27254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.148292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42961 (local address 127.0.0.1:42524)
0808 05:04:05.148705 (+ 413us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:05.148716 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:05.148771 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:05.149180 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:05.149181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:05.149184 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:05.149266 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.149268 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.150656 (+ 1388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.150657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.151592 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.151594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.152436 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.152437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.152523 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.152537 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:04:05.152643 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 05:04:05.152703 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":390,"mutex_wait_us":2,"thread_start_us":79,"threads_started":1}
I20260808 05:04:05.152822 27252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.148427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42524 (local address 127.11.70.193:42961)
0808 05:04:05.148628 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:05.148633 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:05.148790 (+ 157us) server_negotiation.cc:407] Connection header received
0808 05:04:05.148847 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:05.148849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:05.148869 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:05.149073 (+ 204us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:05.149342 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.150516 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.151685 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.152330 (+ 645us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.152405 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.152460 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:05.152677 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 05:04:05.152728 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
I20260808 05:04:05.152910 27249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.148284 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:45543 (local address 127.0.0.1:46418)
0808 05:04:05.148485 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:05.148527 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:05.148591 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:05.149176 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:05.149179 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:05.149181 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:05.149269 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.149272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.150638 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.150639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.151877 (+ 1238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.151879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.152685 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.152685 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.152746 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.152749 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:04:05.152782 (+ 33us) client_negotiation.cc:240] Negotiation successful
0808 05:04:05.152821 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":29,"thread_start_us":72,"threads_started":1}
I20260808 05:04:05.153311 27246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.148513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:45003 (local address 127.0.0.1:51920)
0808 05:04:05.148799 (+ 286us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:05.148808 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:05.148846 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:05.149305 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:05.149307 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:05.149309 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:05.149351 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.149353 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.150309 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.150310 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.151838 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.151841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.152816 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.152818 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.153083 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.153087 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:04:05.153180 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 05:04:05.153226 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":139,"threads_started":1}
I20260808 05:04:05.153584 27250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.148372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46418 (local address 127.11.70.195:45543)
0808 05:04:05.148986 (+ 614us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:05.148990 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:05.148998 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:04:05.149038 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:05.149040 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:05.149056 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:05.149354 (+ 298us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:05.149429 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.150515 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.151977 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.152582 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.153274 (+ 692us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.153345 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:05.153450 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 05:04:05.153497 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":89,"threads_started":1}
I20260808 05:04:05.153596 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.148840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.11.70.194:45003)
0808 05:04:05.149059 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:05.149064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:05.149075 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:04:05.149118 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:05.149120 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:05.149138 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:05.149224 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:05.149414 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.150194 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.151942 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.152656 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.152726 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.152779 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:05.153483 (+ 704us) server_negotiation.cc:299] Negotiation successful
0808 05:04:05.153533 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":86,"threads_started":1}
I20260808 05:04:05.153703 26758 tablet_service.cc:1467] Processing CreateTablet for tablet f7a3be9a6535449cb266deee574b6321 (DEFAULT_TABLE table=test-table [id=439942b8fba84683b892072e33bdf815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:04:05.154145 26758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7a3be9a6535449cb266deee574b6321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:05.154285 27131 tablet_service.cc:1467] Processing CreateTablet for tablet f7a3be9a6535449cb266deee574b6321 (DEFAULT_TABLE table=test-table [id=439942b8fba84683b892072e33bdf815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:04:05.154659 27131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7a3be9a6535449cb266deee574b6321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:05.154716 26945 tablet_service.cc:1467] Processing CreateTablet for tablet f7a3be9a6535449cb266deee574b6321 (DEFAULT_TABLE table=test-table [id=439942b8fba84683b892072e33bdf815]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:04:05.155077 26945 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7a3be9a6535449cb266deee574b6321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:05.157361 27256 tablet_bootstrap.cc:492] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: Bootstrap starting.
I20260808 05:04:05.157992 27257 tablet_bootstrap.cc:492] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb: Bootstrap starting.
I20260808 05:04:05.158172 27256 tablet_bootstrap.cc:654] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:05.158763 27257 tablet_bootstrap.cc:654] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:05.158839 27256 log.cc:824] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:05.158842 27258 tablet_bootstrap.cc:492] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: Bootstrap starting.
I20260808 05:04:05.159303 27257 log.cc:824] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:05.159698 27258 tablet_bootstrap.cc:654] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:05.159875 27256 tablet_bootstrap.cc:492] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: No bootstrap required, opened a new log
I20260808 05:04:05.159970 27256 ts_tablet_manager.cc:1397] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260808 05:04:05.160107 27257 tablet_bootstrap.cc:492] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb: No bootstrap required, opened a new log
I20260808 05:04:05.160190 27257 ts_tablet_manager.cc:1397] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:04:05.160354 27258 log.cc:824] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:05.161193 27258 tablet_bootstrap.cc:492] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: No bootstrap required, opened a new log
I20260808 05:04:05.161271 27258 ts_tablet_manager.cc:1397] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:04:05.162097 27257 raft_consensus.cc:348] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } }
I20260808 05:04:05.162254 27257 raft_consensus.cc:374] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:05.162302 27257 raft_consensus.cc:729] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2756e2adda884088a7b1d2af969886bb, State: Initialized, Role: FOLLOWER
I20260808 05:04:05.162278 27256 raft_consensus.cc:348] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } }
I20260808 05:04:05.162417 27257 consensus_queue.cc:260] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } }
I20260808 05:04:05.162456 27256 raft_consensus.cc:374] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:05.162532 27256 raft_consensus.cc:729] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbccaf7fc2d2483db886e0a66b884ae1, State: Initialized, Role: FOLLOWER
I20260808 05:04:05.162667 27256 consensus_queue.cc:260] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } }
I20260808 05:04:05.162738 27257 ts_tablet_manager.cc:1428] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:04:05.162885 26856 heartbeater.cc:503] Master 127.11.70.254:36923 was elected leader, sending a full tablet report...
I20260808 05:04:05.162972 27256 ts_tablet_manager.cc:1428] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:04:05.163127 27229 heartbeater.cc:503] Master 127.11.70.254:36923 was elected leader, sending a full tablet report...
I20260808 05:04:05.163600 27258 raft_consensus.cc:348] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } }
I20260808 05:04:05.163760 27258 raft_consensus.cc:374] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:05.163806 27258 raft_consensus.cc:729] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c1932dc85804801ac0c7ac8fb7fe8b3, State: Initialized, Role: FOLLOWER
I20260808 05:04:05.163945 27258 consensus_queue.cc:260] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } }
I20260808 05:04:05.164274 27258 ts_tablet_manager.cc:1428] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:04:05.164361 27035 heartbeater.cc:503] Master 127.11.70.254:36923 was elected leader, sending a full tablet report...
W20260808 05:04:05.204604 27036 tablet.cc:2369] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:04:05.220288 27264 raft_consensus.cc:482] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:04:05.220468 27264 raft_consensus.cc:504] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } }
I20260808 05:04:05.220964 27264 leader_election.cc:288] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c1932dc85804801ac0c7ac8fb7fe8b3 (127.11.70.194:45003), 2756e2adda884088a7b1d2af969886bb (127.11.70.193:42961)
I20260808 05:04:05.224578 27255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.221286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:45853 (local address 127.11.70.194:45003)
0808 05:04:05.221659 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:05.221661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:05.221670 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:04:05.221700 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:05.221701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:05.221710 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:05.221770 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:05.221984 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.222757 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.223809 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.224197 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.224296 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.224305 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:05.224468 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 05:04:05.224511 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":345}
I20260808 05:04:05.224578 27232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.221133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:45003 (local address 127.11.70.195:45853)
0808 05:04:05.221184 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:05.221198 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:05.221259 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:05.221803 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:05.221804 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:05.221806 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:05.221882 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.221883 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.222864 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.222865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.223695 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.223698 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.224293 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.224294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.224378 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.224382 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:04:05.224460 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:04:05.224500 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:04:05.224987 27252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.221583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:33387 (local address 127.11.70.193:42961)
0808 05:04:05.222449 (+ 866us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:05.222451 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:05.222498 (+ 47us) server_negotiation.cc:407] Connection header received
0808 05:04:05.222532 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:05.222534 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:05.222543 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:05.222606 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:05.222815 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.223333 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.224211 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.224607 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.224696 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.224704 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:05.224880 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 05:04:05.224924 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":835}
I20260808 05:04:05.224994 27266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.221378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42961 (local address 127.11.70.195:33387)
0808 05:04:05.221572 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:05.221583 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:05.221634 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:05.222625 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:05.222626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:05.222629 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:05.222707 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.222709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.223417 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.223417 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.224116 (+ 699us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:05.224117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.224696 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.224698 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:05.224784 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.224788 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:04:05.224868 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:04:05.224907 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":135,"threads_started":1}
I20260808 05:04:05.224944 26972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7a3be9a6535449cb266deee574b6321" candidate_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" is_pre_election: true
I20260808 05:04:05.225136 26972 raft_consensus.cc:2454] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbccaf7fc2d2483db886e0a66b884ae1 in term 0.
I20260808 05:04:05.225381 27063 leader_election.cc:302] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c1932dc85804801ac0c7ac8fb7fe8b3, fbccaf7fc2d2483db886e0a66b884ae1; no voters:
I20260808 05:04:05.225508 26787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7a3be9a6535449cb266deee574b6321" candidate_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2756e2adda884088a7b1d2af969886bb" is_pre_election: true
I20260808 05:04:05.225593 27264 raft_consensus.cc:2781] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:04:05.225688 27264 raft_consensus.cc:482] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:04:05.225682 26787 raft_consensus.cc:2454] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbccaf7fc2d2483db886e0a66b884ae1 in term 0.
I20260808 05:04:05.225723 27264 raft_consensus.cc:3037] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:04:05.226523 27264 raft_consensus.cc:504] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } }
I20260808 05:04:05.226686 27264 leader_election.cc:288] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [CANDIDATE]: Term 1 election: Requested vote from peers 6c1932dc85804801ac0c7ac8fb7fe8b3 (127.11.70.194:45003), 2756e2adda884088a7b1d2af969886bb (127.11.70.193:42961)
I20260808 05:04:05.226842 26787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7a3be9a6535449cb266deee574b6321" candidate_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2756e2adda884088a7b1d2af969886bb"
I20260808 05:04:05.226845 26972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7a3be9a6535449cb266deee574b6321" candidate_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3"
I20260808 05:04:05.226926 26972 raft_consensus.cc:3037] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:04:05.226949 26787 raft_consensus.cc:3037] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:04:05.227669 26972 raft_consensus.cc:2454] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbccaf7fc2d2483db886e0a66b884ae1 in term 1.
I20260808 05:04:05.227807 26787 raft_consensus.cc:2454] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbccaf7fc2d2483db886e0a66b884ae1 in term 1.
I20260808 05:04:05.227837 27063 leader_election.cc:302] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c1932dc85804801ac0c7ac8fb7fe8b3, fbccaf7fc2d2483db886e0a66b884ae1; no voters:
I20260808 05:04:05.227910 27264 raft_consensus.cc:2781] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:04:05.228078 27264 raft_consensus.cc:686] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 1 LEADER]: Becoming Leader. State: Replica: fbccaf7fc2d2483db886e0a66b884ae1, State: Running, Role: LEADER
I20260808 05:04:05.228200 27264 consensus_queue.cc:237] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } }
I20260808 05:04:05.229044 26580 catalog_manager.cc:5495] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbccaf7fc2d2483db886e0a66b884ae1 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fbccaf7fc2d2483db886e0a66b884ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 45543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 } health_report { overall_health: UNKNOWN } } }
I20260808 05:04:05.245477 27250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.243386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46424 (local address 127.11.70.195:45543)
0808 05:04:05.243447 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:05.243449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:05.243458 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:04:05.243501 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:05.243501 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:05.243517 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:05.243579 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:04:05.243704 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.244156 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.244857 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:05.245029 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:05.245077 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:05.245206 (+ 129us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:04:05.245300 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:04:05.245360 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:05.245389 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 05:04:05.245405 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:04:05.247329 26972 raft_consensus.cc:1261] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [term 1 FOLLOWER]: Refusing update from remote peer fbccaf7fc2d2483db886e0a66b884ae1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:04:05.247339 26787 raft_consensus.cc:1261] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [term 1 FOLLOWER]: Refusing update from remote peer fbccaf7fc2d2483db886e0a66b884ae1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:04:05.247668 27267 consensus_queue.cc:1035] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c1932dc85804801ac0c7ac8fb7fe8b3" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 45003 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:04:05.247812 27264 consensus_queue.cc:1035] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2756e2adda884088a7b1d2af969886bb" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42961 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:04:05.250123 27271 mvcc.cc:205] Tried to move back new op lower bound from 7316133663730442240 to 7316133663655403520. Current Snapshot: MvccSnapshot[applied={T|T < 7316133663730442240}]
I20260808 05:04:05.250293 27272 mvcc.cc:205] Tried to move back new op lower bound from 7316133663730442240 to 7316133663655403520. Current Snapshot: MvccSnapshot[applied={T|T < 7316133663730442240}]
I20260808 05:04:05.250993 27274 mvcc.cc:205] Tried to move back new op lower bound from 7316133663730442240 to 7316133663655403520. Current Snapshot: MvccSnapshot[applied={T|T < 7316133663730442240 or (T in {7316133663730442240})}]
I20260808 05:04:05.252502 26579 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:04:05.252604 26579 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45794:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:04:05.253393 26579 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ceeee7d0921e40199aa1fdd3783f4dd4: Sending DeleteTablet for 3 replicas of tablet f7a3be9a6535449cb266deee574b6321
I20260808 05:04:05.253721 27131 tablet_service.cc:1514] Processing DeleteTablet for tablet f7a3be9a6535449cb266deee574b6321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:04:05 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:46418
I20260808 05:04:05.253762 26758 tablet_service.cc:1514] Processing DeleteTablet for tablet f7a3be9a6535449cb266deee574b6321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:04:05 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:42524
I20260808 05:04:05.253978 27292 tablet_replica.cc:330] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: stopping tablet replica
I20260808 05:04:05.254004 27293 tablet_replica.cc:330] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb: stopping tablet replica
I20260808 05:04:05.254112 27293 raft_consensus.cc:2229] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:04:05.254115 27292 raft_consensus.cc:2229] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:04:05.254189 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 26669
I20260808 05:04:05.254220 27293 raft_consensus.cc:2258] T f7a3be9a6535449cb266deee574b6321 P 2756e2adda884088a7b1d2af969886bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:04:05.254917 27292 raft_consensus.cc:2258] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:04:05.257087 27292 ts_tablet_manager.cc:1905] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:04:05.259464 27292 ts_tablet_manager.cc:1918] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:04:05.259536 27292 log.cc:1196] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/f7a3be9a6535449cb266deee574b6321
I20260808 05:04:05.259791 27292 ts_tablet_manager.cc:1939] T f7a3be9a6535449cb266deee574b6321 P fbccaf7fc2d2483db886e0a66b884ae1: Deleting consensus metadata
I20260808 05:04:05.262219 26945 tablet_service.cc:1514] Processing DeleteTablet for tablet f7a3be9a6535449cb266deee574b6321 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:04:05 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:51920
I20260808 05:04:05.263025 26561 catalog_manager.cc:4841] TS fbccaf7fc2d2483db886e0a66b884ae1 (127.11.70.195:45543): tablet f7a3be9a6535449cb266deee574b6321 (table test-table [id=439942b8fba84683b892072e33bdf815]) successfully deleted
I20260808 05:04:05.264358 27294 tablet_replica.cc:330] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: stopping tablet replica
I20260808 05:04:05.264482 27294 raft_consensus.cc:2229] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:04:05.264587 27294 raft_consensus.cc:2258] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:04:05.265182 27294 ts_tablet_manager.cc:1905] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:04:05.267421 27294 ts_tablet_manager.cc:1918] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:04:05.267509 27294 log.cc:1196] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/f7a3be9a6535449cb266deee574b6321
I20260808 05:04:05.267825 27294 ts_tablet_manager.cc:1939] T f7a3be9a6535449cb266deee574b6321 P 6c1932dc85804801ac0c7ac8fb7fe8b3: Deleting consensus metadata
I20260808 05:04:05.268282 26561 catalog_manager.cc:4841] TS 6c1932dc85804801ac0c7ac8fb7fe8b3 (127.11.70.194:45003): tablet f7a3be9a6535449cb266deee574b6321 (table test-table [id=439942b8fba84683b892072e33bdf815]) successfully deleted
W20260808 05:04:05.269843 26563 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:42961 (error 108)
I20260808 05:04:05.270442 27254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:05.270292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42961 (local address 127.0.0.1:42534)
0808 05:04:05.270361 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:05.270406 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:42961: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 05:04:05.270538 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 26861
W20260808 05:04:05.270617 26563 catalog_manager.cc:4584] TS 2756e2adda884088a7b1d2af969886bb (127.11.70.193:42961): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f7a3be9a6535449cb266deee574b6321: Network error: Client connection negotiation failed: client connection to 127.11.70.193:42961: connect: Connection refused (error 111)
I20260808 05:04:05.278296 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 27040
I20260808 05:04:05.291913 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 26539
2026-08-08T05:04:05Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2225 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:04:05 dist-test-slave-7kzw krb5kdc[27299](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:04:05 dist-test-slave-7kzw krb5kdc[27299](info): set up 2 sockets
Aug 08 05:04:05 dist-test-slave-7kzw krb5kdc[27299](info): commencing operation
krb5kdc: starting...
W20260808 05:04:06.529096 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.214s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:04:06 dist-test-slave-7kzw krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165446, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:04:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:04:06Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.70.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.70.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/rangeradmin_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/rangeradmin_127.11.70.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.70.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.70.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/rangerlookup_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/rangerlookup_127.11.70.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.70.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.70.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/HTTP_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/HTTP_127.11.70.212@KRBTEST.COM.keytab.
I20260808 05:04:06.696998 11547 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJXTM0Z/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/postgres -l logfile start
2026-08-08 05:04:09.208 UTC [27346] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 05:04:09.208 UTC [27346] LOG: listening on IPv4 address "127.11.70.212", port 58737
2026-08-08 05:04:09.212 UTC [27346] LOG: listening on Unix socket "/tmp/.s.PGSQL.58737"
2026-08-08 05:04:09.234 UTC [27350] LOG: database system was shut down at 2026-08-08 05:04:07 UTC
2026-08-08 05:04:09.237 UTC [27346] LOG: database system is ready to accept connections
I20260808 05:04:10.390096 11547 mini_postgres.cc:96] Postgres bound to 58737
2026-08-08 05:04:10.399 UTC [27360] FATAL: database "slave" does not exist
127.11.70.212:58737 - accepting connections
I20260808 05:04:10.399801 11547 mini_ranger.cc:161] Starting Ranger...
I20260808 05:04:10.416318 11547 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 05:04:10.864609 11547 mini_ranger.cc:87] Created ranger Postgres database
I20260808 05:04:10.864709 11547 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-admin
2026-08-08 05:04:11,204 [I] DB FLAVOR :POSTGRES
2026-08-08 05:04:11,204 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:04:11,204 [I] Checking connection..
2026-08-08 05:04:11,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 05:04:11,458 [I] Checking connection passed.
2026-08-08 05:04:11,458 [I] --------- Verifying version history table ---------
2026-08-08 05:04:11,459 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:04:11,705 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:04:11,706 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:04:11,940 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:04:11,940 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 05:04:11,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 05:04:12.205 UTC [27461] WARNING: there is no transaction in progress
2026-08-08 05:04:12,214 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 05:04:12,214 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:04:12,450 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 05:04:12,450 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:04:12,451 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 05:04:12,689 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 05:04:12,930 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7kzw.c.gcp-upstream.internal','N') ;"
2026-08-08 05:04:13,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:04:13,442 [I] Table x_portal_user does not exist in database ranger
2026-08-08 05:04:13,442 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:04:13,711 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 05:04:13,711 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:04:13,968 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:04:14,206 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 05:04:14,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 05:04:15.172 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.188 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.204 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.219 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.234 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.252 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.316 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.322 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.336 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.346 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.357 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.370 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.379 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.386 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.393 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:15.399 UTC [27612] WARNING: there is no transaction in progress
2026-08-08 05:04:16,042 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 05:04:16,043 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 05:04:16,288 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 05:04:16,288 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:04:16,554 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 05:04:16,555 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:04:16,825 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 05:04:16,826 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:04:17,094 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:04:17,360 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7kzw.c.gcp-upstream.internal';"
2026-08-08 05:04:17,621 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 05:04:17,622 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 05:04:17,864 [I] DB_PATCHES have already been applied
I20260808 05:04:17.870167 11547 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJXTM0Z/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 05:04:17.870232 11547 mini_ranger.cc:193] Using host: 127.11.70.212
I20260808 05:04:17.874104 11547 mini_ranger.cc:227] Ranger admin URL: http://127.11.70.212:43583
Aug 08, 2026 5:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:04:18 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 05:04:19.276968 11547 mini_ranger.cc:160] Time spent starting Ranger: real 8.877s user 0.000s sys 0.011s
Aug 08, 2026 5:04:38 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:04:39 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 08, 2026 5:04:39 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:04:39 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:04:40 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 05:04:40.617129 11547 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.70.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.70.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/rangerkms_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/rangerkms_127.11.70.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.70.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.70.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.70.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/HTTP_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.70.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/HTTP_127.11.70.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 05:04:40 dist-test-slave-7kzw krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165480, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 05:04:40.722054 11547 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 05:04:40.733530 11547 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 05:04:41.650861 11547 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 05:04:41.650961 11547 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-kms
I20260808 05:04:41.650986 11547 mini_ranger_kms.cc:227] Using postgres at 127.11.70.212:58737
2026-08-08 05:04:41,889 [I] DB FLAVOR :POSTGRES
2026-08-08 05:04:41,889 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:04:41,889 [I] Checking connection
2026-08-08 05:04:41,890 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 05:04:42,142 [I] connection success
2026-08-08 05:04:42,143 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 05:04:42,143 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 05:04:42,143 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 05:04:42,385 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 05:04:42,386 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:04:42,386 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 05:04:42,386 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:58737/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 05:04:42,682 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 05:04:43.199555 11547 mini_ranger_kms.cc:310] Created kms service
I20260808 05:04:43.409462 11547 mini_ranger_kms.cc:326] Created kudu user
I20260808 05:04:43.455027 11547 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 05:04:43 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165480, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:04:43.865917 11547 mini_ranger_kms.cc:384] Added ranger policy
I20260808 05:04:43.866040 11547 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 05:04:43.866063 11547 mini_ranger_kms.cc:240] Using host: 127.11.70.212
I20260808 05:04:43.871119 11547 mini_ranger_kms.cc:276] Ranger KMS PID: 27863
I20260808 05:04:43.871255 11547 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.70.212:41843
Aug 08, 2026 5:04:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:04:44 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:04:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:04:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:04:45 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:04:45 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 05:04:46 dist-test-slave-7kzw krb5kdc[27299](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165486, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.70.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:04:46.566179 11547 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.844s user 0.000s sys 0.218s
I20260808 05:04:46.566305 11547 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 05:04:46.566386 11547 mini_ranger_kms.cc:401] 127.11.70.212:41843/kms/v1/keys
Aug 08 05:04:46 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165486, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.70.212@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
Aug 08 05:04:47 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165486, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.70.212@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
Aug 08 05:04:49 dist-test-slave-7kzw krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:04:49.502326 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37233
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:39247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:37233
--ranger_config_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:41843/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:04:49.607239 27935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:49.607549 27935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:49.607595 27935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:49.608969 27935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:04:49.609052 27935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:49.609082 27935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:49.609118 27935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:04:49.609150 27935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:04:49.611228 27935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:39247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.70.212:41843/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:37233
--ranger_config_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27935
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:49.611543 27935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:49.611804 27935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:49.617723 27941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:49.617779 27946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:49.617858 27943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:49.617882 27935 server_base.cc:1034] running on GCE node
I20260808 05:04:49.618247 27935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:49.618618 27935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:49.619796 27935 hybrid_clock.cc:648] HybridClock initialized: now 1786165489619777 us; error 28 us; skew 500 ppm
Aug 08 05:04:49 dist-test-slave-7kzw krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165489, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:04:49.622753 27935 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:04:49.623260 27935 webserver.cc:460] Webserver started at http://127.11.70.254:33795/ using document root <none> and password file <none>
I20260808 05:04:49.623500 27935 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:49.623565 27935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:49.623732 27935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:04:49 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165489, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:04:49.684607 27935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "0ca7306b82814238a1f6a84476204617"
format_stamp: "Formatted at 2026-08-08 05:04:49 on dist-test-slave-7kzw"
server_key: "00cbeca4b5dd90c709cc60d3f4e0cae0"
server_key_iv: "8f44f6943b93165b0616de0c9ea30777"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:49.685195 27935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "0ca7306b82814238a1f6a84476204617"
format_stamp: "Formatted at 2026-08-08 05:04:49 on dist-test-slave-7kzw"
server_key: "00cbeca4b5dd90c709cc60d3f4e0cae0"
server_key_iv: "8f44f6943b93165b0616de0c9ea30777"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:49.687477 27935 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 05:04:49.703567 27956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:49.703814 27935 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:49.703920 27935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "0ca7306b82814238a1f6a84476204617"
format_stamp: "Formatted at 2026-08-08 05:04:49 on dist-test-slave-7kzw"
server_key: "00cbeca4b5dd90c709cc60d3f4e0cae0"
server_key_iv: "8f44f6943b93165b0616de0c9ea30777"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:49.704021 27935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:49.729683 27935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:49.731812 27935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:49.731982 27935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:49.741237 27935 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:37233
I20260808 05:04:49.741326 28034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:37233 every 8 connection(s)
I20260808 05:04:49.741784 27935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:04:49.742815 28035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:49.745918 28035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617: Bootstrap starting.
I20260808 05:04:49.746824 28035 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:49.747473 28035 log.cc:824] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:49.748330 28035 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617: No bootstrap required, opened a new log
I20260808 05:04:49.750267 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 27935
I20260808 05:04:49.750398 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:04:49.750613 11547 external_mini_cluster.cc:1428] Setting key 2ae1c68e9ff7baed23e64af9decae0ca
I20260808 05:04:49.752444 28035 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7306b82814238a1f6a84476204617" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37233 } }
I20260808 05:04:49.752650 28035 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:49.752700 28035 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ca7306b82814238a1f6a84476204617, State: Initialized, Role: FOLLOWER
I20260808 05:04:49.752831 28035 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7306b82814238a1f6a84476204617" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37233 } }
I20260808 05:04:49.752925 28035 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:04:49.752960 28035 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:04:49.753013 28035 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:04:49.753939 28035 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7306b82814238a1f6a84476204617" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37233 } }
I20260808 05:04:49.754122 28035 leader_election.cc:302] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ca7306b82814238a1f6a84476204617; no voters:
I20260808 05:04:49.754302 28035 leader_election.cc:288] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:04:49.754439 28040 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:04:49.754822 28035 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:04:49.754823 28040 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [term 1 LEADER]: Becoming Leader. State: Replica: 0ca7306b82814238a1f6a84476204617, State: Running, Role: LEADER
I20260808 05:04:49.755090 28040 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7306b82814238a1f6a84476204617" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37233 } }
I20260808 05:04:49.755782 28042 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ca7306b82814238a1f6a84476204617. Latest consensus state: current_term: 1 leader_uuid: "0ca7306b82814238a1f6a84476204617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7306b82814238a1f6a84476204617" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37233 } } }
I20260808 05:04:49.755908 28042 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [sys.catalog]: This master's current role is: LEADER
I20260808 05:04:49.756381 28041 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ca7306b82814238a1f6a84476204617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ca7306b82814238a1f6a84476204617" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37233 } } }
I20260808 05:04:49.756474 28041 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617 [sys.catalog]: This master's current role is: LEADER
I20260808 05:04:49.756870 28049 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:04:49.757673 28049 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:04:49.758270 28035 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 08 05:04:49 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165489, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:04:49.770807 28039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:49.751551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57940 (local address 127.11.70.254:37233)
0808 05:04:49.752238 (+ 687us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:49.752248 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:49.752316 (+ 68us) server_negotiation.cc:407] Connection header received
0808 05:04:49.752517 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:49.752525 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:49.752594 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:49.752757 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:49.753672 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:49.755540 (+ 1868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:49.756768 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:49.757411 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:49.757525 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:49.762794 (+ 5269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:49.762871 (+ 77us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:49.762872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:49.763070 (+ 198us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:49.767273 (+ 4203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:49.767783 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:49.767788 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:49.767788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:49.768023 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:49.768317 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:49.768318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:49.768319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:49.768708 (+ 389us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:49.769009 (+ 301us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:49.770161 (+ 1152us) server_negotiation.cc:299] Negotiation successful
0808 05:04:49.770323 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":246,"threads_started":1}
I20260808 05:04:49.771101 28049 catalog_manager.cc:1347] Generated new cluster ID: 35c035fa8caa471fa660a7267f391696
I20260808 05:04:49.771396 28049 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:04:49.792375 28049 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:04:49.793121 28049 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:04:49.799440 28049 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617: Generated new TSK 0
I20260808 05:04:49.799629 28049 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:04:50.498845 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:41843/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37233
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:39247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:04:50.606841 28098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:50.607049 28098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:50.607074 28098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:50.608263 28098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:50.608306 28098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:50.608333 28098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:04:50.609894 28098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:39247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.70.212:41843/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37233
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:50.610143 28098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:50.610406 28098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:50.616092 28110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:50.616325 28098 server_base.cc:1034] running on GCE node
W20260808 05:04:50.616098 28108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:50.616571 28112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:50.616808 28098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:50.617072 28098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:50.618247 28098 hybrid_clock.cc:648] HybridClock initialized: now 1786165490618226 us; error 34 us; skew 500 ppm
Aug 08 05:04:50 dist-test-slave-7kzw krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165490, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:04:50.621693 28098 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:04:50.622268 28098 webserver.cc:460] Webserver started at http://127.11.70.193:34497/ using document root <none> and password file <none>
I20260808 05:04:50.622611 28098 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:50.622727 28098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:50.622910 28098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:04:50 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165490, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:04:50.636338 28098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "e098d1fe27734938888f5e9c213671ba"
format_stamp: "Formatted at 2026-08-08 05:04:50 on dist-test-slave-7kzw"
server_key: "78fc165cd861d64f8a011ca877f8f403"
server_key_iv: "1f237e1c6235a652641b13576e6ddef6"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:50.636889 28098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "e098d1fe27734938888f5e9c213671ba"
format_stamp: "Formatted at 2026-08-08 05:04:50 on dist-test-slave-7kzw"
server_key: "78fc165cd861d64f8a011ca877f8f403"
server_key_iv: "1f237e1c6235a652641b13576e6ddef6"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:50.639809 28098 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:04:50.659511 28124 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:50.659768 28098 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s
I20260808 05:04:50.659864 28098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "e098d1fe27734938888f5e9c213671ba"
format_stamp: "Formatted at 2026-08-08 05:04:50 on dist-test-slave-7kzw"
server_key: "78fc165cd861d64f8a011ca877f8f403"
server_key_iv: "1f237e1c6235a652641b13576e6ddef6"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:50.659958 28098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:50.687068 28098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:50.689440 28098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:50.689620 28098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:50.689896 28098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:50.690321 28098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:50.690377 28098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:50.690448 28098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:50.690512 28098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:50.698009 28098 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:43863
I20260808 05:04:50.698421 28098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:04:50.703336 28295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:43863 every 8 connection(s)
I20260808 05:04:50.706964 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 28098
I20260808 05:04:50.707077 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:04:50.707297 11547 external_mini_cluster.cc:1428] Setting key 52d63c76f24bfc65a02b36825dd2de29
Aug 08 05:04:50 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165490, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:04:50.716213 28299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:50.703795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37233 (local address 127.11.70.193:56715)
0808 05:04:50.704045 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:50.704099 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:50.704754 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:50.705208 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:50.705213 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:50.705474 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:50.705761 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:50.705767 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:50.706849 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:50.706850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:50.708778 (+ 1928us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:50.708781 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:50.709390 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:50.709391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:50.709547 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:50.710196 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:50.710209 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:50.711926 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:50.714235 (+ 2309us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:50.714244 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:50.714247 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:50.714615 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:50.714857 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:50.714858 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:50.714858 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:50.715012 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:50.715371 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:50.715379 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:50.715565 (+ 186us) client_negotiation.cc:769] Sending connection context
0808 05:04:50.715683 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 05:04:50.715874 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":97,"threads_started":1}
I20260808 05:04:50.717098 28300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:50.703826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:56715 (local address 127.11.70.254:37233)
0808 05:04:50.704957 (+ 1131us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:50.704959 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:50.704968 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:04:50.704995 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:50.704996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:50.705009 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:50.705076 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:50.705880 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:50.706718 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:50.708890 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:50.709232 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:50.709312 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:50.712034 (+ 2722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:50.712036 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:50.712037 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:50.712047 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:50.714116 (+ 2069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:50.714708 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:50.714709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:50.714710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:50.714784 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:50.715089 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:50.715090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:50.715090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:50.715267 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:50.715340 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:50.716875 (+ 1535us) server_negotiation.cc:299] Negotiation successful
0808 05:04:50.716975 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1095,"thread_start_us":96,"threads_started":1}
I20260808 05:04:50.717736 28296 heartbeater.cc:347] Connected to a master server at 127.11.70.254:37233
I20260808 05:04:50.717839 28296 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:50.718050 28296 heartbeater.cc:511] Master 127.11.70.254:37233 requested a full tablet report, sending...
I20260808 05:04:50.718645 27980 ts_manager.cc:194] Registered new tserver with Master: e098d1fe27734938888f5e9c213671ba (127.11.70.193:43863)
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
I20260808 05:04:50.719594 27980 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:56715
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:04:50.745208 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:41843/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37233
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:39247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:04:50 dist-test-slave-7kzw krb5kdc[27299](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165490, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 05:04:50.870347 28303 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:50.870682 28303 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:50.870718 28303 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:50.872400 28303 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:50.872505 28303 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:50.872565 28303 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:04:50.874825 28303 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:39247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.70.212:41843/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37233
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28303
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:50.875238 28303 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:50.875593 28303 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:50.883311 28323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:50.883584 28316 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:50.883785 28317 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:50.884462 28303 server_base.cc:1034] running on GCE node
I20260808 05:04:50.884760 28303 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:50.885049 28303 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:50.886227 28303 hybrid_clock.cc:648] HybridClock initialized: now 1786165490886206 us; error 40 us; skew 500 ppm
Aug 08 05:04:50 dist-test-slave-7kzw krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165490, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:04:50.888952 28303 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:04:50.889405 28303 webserver.cc:460] Webserver started at http://127.11.70.194:39651/ using document root <none> and password file <none>
I20260808 05:04:50.889643 28303 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:50.889724 28303 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:50.889883 28303 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:04:50 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165490, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:04:50.904013 28303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "ae6de7e4a8714d0089b55c8cfdb87df7"
format_stamp: "Formatted at 2026-08-08 05:04:50 on dist-test-slave-7kzw"
server_key: "d5c591e2982a24508e6cf80bf8b9d5cc"
server_key_iv: "46e16a2851f285e3aef6a49f9040b567"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:50.904611 28303 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "ae6de7e4a8714d0089b55c8cfdb87df7"
format_stamp: "Formatted at 2026-08-08 05:04:50 on dist-test-slave-7kzw"
server_key: "d5c591e2982a24508e6cf80bf8b9d5cc"
server_key_iv: "46e16a2851f285e3aef6a49f9040b567"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:50.906859 28303 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:04:50.921821 28331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:50.922138 28303 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:50.922262 28303 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "ae6de7e4a8714d0089b55c8cfdb87df7"
format_stamp: "Formatted at 2026-08-08 05:04:50 on dist-test-slave-7kzw"
server_key: "d5c591e2982a24508e6cf80bf8b9d5cc"
server_key_iv: "46e16a2851f285e3aef6a49f9040b567"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:50.922361 28303 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:50.937415 28303 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:50.940003 28303 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:50.940165 28303 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:50.940397 28303 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:50.940755 28303 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:50.940837 28303 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:50.940882 28303 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:50.940900 28303 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:50.948103 28303 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:46479
I20260808 05:04:50.948539 28303 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:04:50.951975 28491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:46479 every 8 connection(s)
I20260808 05:04:50.953233 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 28303
I20260808 05:04:50.953357 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:04:50.953541 11547 external_mini_cluster.cc:1428] Setting key ffefbbc8b2000e7aa446d221d293ffe6
Aug 08 05:04:50 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165490, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:04:50.961058 28495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:50.949357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37233 (local address 127.11.70.194:54251)
0808 05:04:50.949585 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:50.949637 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:50.950293 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:50.950719 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:50.950724 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:50.951030 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:50.951341 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:50.951348 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:50.952403 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:50.952404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:50.953630 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:50.953633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:50.954374 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:50.954375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:50.954559 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:50.955195 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:50.955206 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:50.956893 (+ 1687us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:50.959054 (+ 2161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:50.959063 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:50.959065 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:50.959387 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:50.959625 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:50.959626 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:50.959626 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:50.959769 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:50.960207 (+ 438us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:50.960215 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:50.960409 (+ 194us) client_negotiation.cc:769] Sending connection context
0808 05:04:50.960556 (+ 147us) client_negotiation.cc:240] Negotiation successful
0808 05:04:50.960748 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":107,"threads_started":1}
I20260808 05:04:50.961891 28300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:50.949703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:54251 (local address 127.11.70.254:37233)
0808 05:04:50.949756 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:50.949759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:50.949772 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:04:50.950436 (+ 664us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:50.950437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:50.950456 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:50.950557 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:50.951470 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:50.952285 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:50.953753 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:50.954038 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:50.954082 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:50.956995 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:50.956996 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:50.956997 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:50.957006 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:50.958957 (+ 1951us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:50.959474 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:50.959475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:50.959476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:50.959538 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:50.959839 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:50.959840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:50.959840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:50.959993 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:50.960158 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:50.961631 (+ 1473us) server_negotiation.cc:299] Negotiation successful
0808 05:04:50.961742 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:04:50.962271 28492 heartbeater.cc:347] Connected to a master server at 127.11.70.254:37233
I20260808 05:04:50.962378 28492 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:50.962600 28492 heartbeater.cc:511] Master 127.11.70.254:37233 requested a full tablet report, sending...
I20260808 05:04:50.963052 27980 ts_manager.cc:194] Registered new tserver with Master: ae6de7e4a8714d0089b55c8cfdb87df7 (127.11.70.194:46479)
I20260808 05:04:50.963436 27980 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:54251
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:04:50.985810 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:41843/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37233
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:39247
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:04:51.086315 28500 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:04:51.086694 28500 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:04:51.086793 28500 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:04:51.088516 28500 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:04:51.088629 28500 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:04:51.088716 28500 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:04:51.090924 28500 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:39247
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.70.212:41843/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:37233
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28500
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:04:51.091399 28500 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:04:51.091734 28500 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:04:51.098789 28509 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:51.099033 28514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:04:51.099334 28508 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:04:51.099974 28500 server_base.cc:1034] running on GCE node
I20260808 05:04:51.100296 28500 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:04:51.100574 28500 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:04:51.101766 28500 hybrid_clock.cc:648] HybridClock initialized: now 1786165491101743 us; error 36 us; skew 500 ppm
Aug 08 05:04:51 dist-test-slave-7kzw krb5kdc[27299](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165491, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:04:51.105208 28500 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:04:51.105741 28500 webserver.cc:460] Webserver started at http://127.11.70.195:38839/ using document root <none> and password file <none>
I20260808 05:04:51.105995 28500 fs_manager.cc:359] Metadata directory not provided
I20260808 05:04:51.106065 28500 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:04:51.106220 28500 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:04:51 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165491, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:04:51.120728 28500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "4ec2459818d849339e21817fcfbb17fe"
format_stamp: "Formatted at 2026-08-08 05:04:51 on dist-test-slave-7kzw"
server_key: "1b25cf83a572ce8fab2c9d122af9934f"
server_key_iv: "20f7a2a70d16234053999f8539cbcdd5"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:51.121186 28500 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "4ec2459818d849339e21817fcfbb17fe"
format_stamp: "Formatted at 2026-08-08 05:04:51 on dist-test-slave-7kzw"
server_key: "1b25cf83a572ce8fab2c9d122af9934f"
server_key_iv: "20f7a2a70d16234053999f8539cbcdd5"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:51.135013 28500 fs_manager.cc:691] Time spent creating directory manager: real 0.014s user 0.003s sys 0.001s
I20260808 05:04:51.149394 28527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:51.149659 28500 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:04:51.149765 28500 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "4ec2459818d849339e21817fcfbb17fe"
format_stamp: "Formatted at 2026-08-08 05:04:51 on dist-test-slave-7kzw"
server_key: "1b25cf83a572ce8fab2c9d122af9934f"
server_key_iv: "20f7a2a70d16234053999f8539cbcdd5"
server_key_version: "kuduclusterkey@0"
I20260808 05:04:51.149863 28500 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:04:51.164916 28500 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:04:51.167311 28500 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:04:51.167438 28500 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:04:51.167672 28500 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:04:51.167992 28500 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:04:51.168089 28500 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:51.168124 28500 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:04:51.168143 28500 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:04:51.177709 28500 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:40459
I20260808 05:04:51.178193 28500 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:04:51.178745 28690 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:40459 every 8 connection(s)
I20260808 05:04:51.183568 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 28500
I20260808 05:04:51.183687 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:04:51.183902 11547 external_mini_cluster.cc:1428] Setting key 310fe5a98f58e4a58106b73800d3b965
Aug 08 05:04:51 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165491, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:04:51.188804 28300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.179471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:38543 (local address 127.11.70.254:37233)
0808 05:04:51.179522 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:51.179525 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:51.179786 (+ 261us) server_negotiation.cc:407] Connection header received
0808 05:04:51.180325 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:51.180326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:51.180339 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:51.180393 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:51.180975 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.181623 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.182696 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.182894 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.182972 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.185463 (+ 2491us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:51.185465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:51.185465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:51.185474 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:51.187190 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:51.187701 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:51.187702 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:51.187702 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:51.187763 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:51.188033 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:51.188034 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:51.188034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:51.188194 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:51.188233 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:51.188621 (+ 388us) server_negotiation.cc:299] Negotiation successful
0808 05:04:51.188710 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:04:51.189311 28694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.179472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:37233 (local address 127.11.70.195:38543)
0808 05:04:51.179636 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:51.179678 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:51.180217 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:51.180476 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:51.180480 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:51.180673 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:04:51.180862 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.180867 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.181733 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.181735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.182600 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.182602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.182980 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.182981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.183114 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.183722 (+ 608us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:04:51.183733 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:04:51.185368 (+ 1635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:04:51.187301 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:51.187308 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:51.187311 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:51.187605 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:51.187835 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:04:51.187836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:04:51.187836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:04:51.187962 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:04:51.188275 (+ 313us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:04:51.188282 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:04:51.188456 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 05:04:51.188967 (+ 511us) client_negotiation.cc:240] Negotiation successful
0808 05:04:51.189141 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":100,"threads_started":1}
I20260808 05:04:51.189744 28692 heartbeater.cc:347] Connected to a master server at 127.11.70.254:37233
I20260808 05:04:51.189836 28692 heartbeater.cc:464] Registering TS with master...
I20260808 05:04:51.190039 28692 heartbeater.cc:511] Master 127.11.70.254:37233 requested a full tablet report, sending...
I20260808 05:04:51.190531 27980 ts_manager.cc:194] Registered new tserver with Master: 4ec2459818d849339e21817fcfbb17fe (127.11.70.195:40459)
I20260808 05:04:51.191021 27980 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:38543
I20260808 05:04:51.195896 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:04:51.206394 28300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.197790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57950 (local address 127.11.70.254:37233)
0808 05:04:51.197835 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:51.197837 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:51.198175 (+ 338us) server_negotiation.cc:407] Connection header received
0808 05:04:51.198210 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:51.198211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:51.198223 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:51.198295 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:04:51.199122 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.199847 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.200843 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.201126 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.201209 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.202934 (+ 1725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:04:51.202935 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:04:51.202936 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:04:51.202944 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:04:51.204888 (+ 1944us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:51.205369 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:51.205370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:51.205371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:51.205438 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:04:51.205717 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:04:51.205718 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:04:51.205719 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:04:51.205859 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:04:51.205945 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:51.206198 (+ 253us) server_negotiation.cc:299] Negotiation successful
0808 05:04:51.206285 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:04:51.208804 27980 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57950:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:04:51.211277 27980 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:04:51.220430 28708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.214377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:40459 (local address 127.0.0.1:38362)
0808 05:04:51.215798 (+ 1421us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:51.215832 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:51.215935 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:51.216236 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:51.216240 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:51.216242 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:51.216322 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.216324 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.217664 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.217665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.219023 (+ 1358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.219027 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.220099 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.220100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.220186 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.220202 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 05:04:51.220273 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 05:04:51.220328 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1382,"thread_start_us":113,"threads_started":1}
I20260808 05:04:51.220956 28712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.214943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38362 (local address 127.11.70.195:40459)
0808 05:04:51.215692 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:51.215698 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:51.215929 (+ 231us) server_negotiation.cc:407] Connection header received
0808 05:04:51.216030 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:51.216032 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:51.216052 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:51.216133 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:51.216405 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.217559 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.219151 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.219910 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.219974 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.220064 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:51.220817 (+ 753us) server_negotiation.cc:299] Negotiation successful
0808 05:04:51.220867 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":698,"thread_start_us":87,"threads_started":1}
I20260808 05:04:51.221837 28593 tablet_service.cc:1467] Processing CreateTablet for tablet 13e1b19e20cc4e50897b5e481dc87647 (DEFAULT_TABLE table=test-table [id=68f30c7f8235474cbe53bb09e08660aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:04:51.222218 28593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13e1b19e20cc4e50897b5e481dc87647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:51.224923 28705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.214378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:43863 (local address 127.0.0.1:46498)
0808 05:04:51.216055 (+ 1677us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:51.216064 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:51.216110 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:51.216404 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:51.216405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:51.216406 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:51.216440 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.216442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.220492 (+ 4050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.220493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.223593 (+ 3100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.223597 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.224678 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.224679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.224743 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.224747 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:04:51.224805 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:04:51.224847 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1661,"mutex_wait_us":11,"thread_start_us":212,"threads_started":1}
I20260808 05:04:51.225909 28706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.214518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46498 (local address 127.11.70.193:43863)
0808 05:04:51.215718 (+ 1200us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:51.215722 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:51.216172 (+ 450us) server_negotiation.cc:407] Connection header received
0808 05:04:51.216219 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:51.216222 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:51.216237 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:51.216321 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:51.216522 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.219893 (+ 3371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.223713 (+ 3820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.224490 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.224570 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.224635 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:51.225049 (+ 414us) server_negotiation.cc:299] Negotiation successful
0808 05:04:51.225097 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1166,"thread_start_us":53,"threads_started":1}
I20260808 05:04:51.226562 28713 tablet_bootstrap.cc:492] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: Bootstrap starting.
I20260808 05:04:51.226612 28181 tablet_service.cc:1467] Processing CreateTablet for tablet 13e1b19e20cc4e50897b5e481dc87647 (DEFAULT_TABLE table=test-table [id=68f30c7f8235474cbe53bb09e08660aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:04:51.226984 28181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13e1b19e20cc4e50897b5e481dc87647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:51.227838 28713 tablet_bootstrap.cc:654] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:51.228272 28713 log.cc:824] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:51.229311 28713 tablet_bootstrap.cc:492] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: No bootstrap required, opened a new log
I20260808 05:04:51.229383 28713 ts_tablet_manager.cc:1397] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:04:51.231690 28713 raft_consensus.cc:348] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } }
I20260808 05:04:51.231887 28713 raft_consensus.cc:374] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:51.231936 28713 raft_consensus.cc:729] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ec2459818d849339e21817fcfbb17fe, State: Initialized, Role: FOLLOWER
I20260808 05:04:51.232060 28713 consensus_queue.cc:260] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } }
I20260808 05:04:51.232319 28713 ts_tablet_manager.cc:1428] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:04:51.232632 28692 heartbeater.cc:503] Master 127.11.70.254:37233 was elected leader, sending a full tablet report...
I20260808 05:04:51.234526 28716 tablet_bootstrap.cc:492] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba: Bootstrap starting.
I20260808 05:04:51.235320 28716 tablet_bootstrap.cc:654] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:51.235673 28716 log.cc:824] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:51.236526 28716 tablet_bootstrap.cc:492] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba: No bootstrap required, opened a new log
I20260808 05:04:51.236609 28716 ts_tablet_manager.cc:1397] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:04:51.239147 28710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.214799 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57318 (local address 127.11.70.194:46479)
0808 05:04:51.220230 (+ 5431us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:51.220235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:51.220259 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:04:51.220307 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:51.220309 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:51.220327 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:51.220398 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:51.221384 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.222433 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.233302 (+ 10869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.234157 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.234278 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.234364 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:51.238979 (+ 4615us) server_negotiation.cc:299] Negotiation successful
0808 05:04:51.239041 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5384,"thread_start_us":143,"threads_started":1}
I20260808 05:04:51.239787 28709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.214671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:46479 (local address 127.0.0.1:57318)
0808 05:04:51.220031 (+ 5360us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:51.220042 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:51.220091 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:51.220885 (+ 794us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:51.220886 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:51.220887 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:51.220926 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.220927 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.232011 (+ 11084us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.232012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.233156 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.233160 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.235733 (+ 2573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.235735 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.238823 (+ 3088us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.238831 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 05:04:51.239598 (+ 767us) client_negotiation.cc:240] Negotiation successful
0808 05:04:51.239686 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5339,"thread_start_us":106,"threads_started":1}
I20260808 05:04:51.239897 28716 raft_consensus.cc:348] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } }
I20260808 05:04:51.240083 28716 raft_consensus.cc:374] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:51.240131 28716 raft_consensus.cc:729] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e098d1fe27734938888f5e9c213671ba, State: Initialized, Role: FOLLOWER
I20260808 05:04:51.240716 28402 tablet_service.cc:1467] Processing CreateTablet for tablet 13e1b19e20cc4e50897b5e481dc87647 (DEFAULT_TABLE table=test-table [id=68f30c7f8235474cbe53bb09e08660aa]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:04:51.241075 28402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13e1b19e20cc4e50897b5e481dc87647. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:04:51.244410 28722 tablet_bootstrap.cc:492] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: Bootstrap starting.
I20260808 05:04:51.240275 28716 consensus_queue.cc:260] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } }
I20260808 05:04:51.244944 28716 ts_tablet_manager.cc:1428] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20260808 05:04:51.245106 28296 heartbeater.cc:503] Master 127.11.70.254:37233 was elected leader, sending a full tablet report...
I20260808 05:04:51.246628 28722 tablet_bootstrap.cc:654] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: Neither blocks nor log segments found. Creating new log.
I20260808 05:04:51.247053 28722 log.cc:824] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:04:51.247967 28722 tablet_bootstrap.cc:492] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: No bootstrap required, opened a new log
I20260808 05:04:51.248057 28722 ts_tablet_manager.cc:1397] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 05:04:51.249665 28722 raft_consensus.cc:348] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } }
I20260808 05:04:51.249854 28722 raft_consensus.cc:374] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:04:51.249903 28722 raft_consensus.cc:729] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae6de7e4a8714d0089b55c8cfdb87df7, State: Initialized, Role: FOLLOWER
I20260808 05:04:51.250033 28722 consensus_queue.cc:260] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } }
I20260808 05:04:51.250330 28722 ts_tablet_manager.cc:1428] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:04:51.250340 28492 heartbeater.cc:503] Master 127.11.70.254:37233 was elected leader, sending a full tablet report...
I20260808 05:04:51.347193 28719 raft_consensus.cc:482] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:04:51.347375 28719 raft_consensus.cc:504] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } }
I20260808 05:04:51.347818 28719 leader_election.cc:288] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e098d1fe27734938888f5e9c213671ba (127.11.70.193:43863), ae6de7e4a8714d0089b55c8cfdb87df7 (127.11.70.194:46479)
I20260808 05:04:51.352257 28694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.347955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:43863 (local address 127.11.70.195:39847)
0808 05:04:51.348313 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:51.348326 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:51.348378 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:51.348853 (+ 475us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:51.348854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:51.348857 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:51.348928 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.348930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.349867 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.349869 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.351166 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.351169 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.351996 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.351997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.352084 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.352087 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:04:51.352133 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:04:51.352174 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":333}
I20260808 05:04:51.353012 28706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.348595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:39847 (local address 127.11.70.193:43863)
0808 05:04:51.348688 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:51.348690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:51.348698 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:04:51.348728 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:51.348728 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:51.348741 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:51.348796 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:51.348997 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.349763 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.351273 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.351881 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.351952 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.351962 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:51.352893 (+ 931us) server_negotiation.cc:299] Negotiation successful
0808 05:04:51.352941 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260808 05:04:51.353284 28209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13e1b19e20cc4e50897b5e481dc87647" candidate_uuid: "4ec2459818d849339e21817fcfbb17fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e098d1fe27734938888f5e9c213671ba" is_pre_election: true
I20260808 05:04:51.353443 28209 raft_consensus.cc:2454] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec2459818d849339e21817fcfbb17fe in term 0.
I20260808 05:04:51.353768 28529 leader_election.cc:302] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec2459818d849339e21817fcfbb17fe, e098d1fe27734938888f5e9c213671ba; no voters:
I20260808 05:04:51.354125 28719 raft_consensus.cc:2781] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:04:51.354193 28719 raft_consensus.cc:482] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:04:51.354218 28719 raft_consensus.cc:3037] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:04:51.355268 28719 raft_consensus.cc:504] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } }
I20260808 05:04:51.355412 28719 leader_election.cc:288] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [CANDIDATE]: Term 1 election: Requested vote from peers e098d1fe27734938888f5e9c213671ba (127.11.70.193:43863), ae6de7e4a8714d0089b55c8cfdb87df7 (127.11.70.194:46479)
I20260808 05:04:51.355851 28209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13e1b19e20cc4e50897b5e481dc87647" candidate_uuid: "4ec2459818d849339e21817fcfbb17fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e098d1fe27734938888f5e9c213671ba"
I20260808 05:04:51.355935 28209 raft_consensus.cc:3037] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba [term 0 FOLLOWER]: Advancing to term 1
Aug 08 05:04:51 dist-test-slave-7kzw krb5kdc[27299](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165490, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:04:51.356848 28209 raft_consensus.cc:2454] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec2459818d849339e21817fcfbb17fe in term 1.
I20260808 05:04:51.357086 28529 leader_election.cc:302] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ec2459818d849339e21817fcfbb17fe, e098d1fe27734938888f5e9c213671ba; no voters:
I20260808 05:04:51.357240 28719 raft_consensus.cc:2781] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:04:51.357389 28719 raft_consensus.cc:686] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 1 LEADER]: Becoming Leader. State: Replica: 4ec2459818d849339e21817fcfbb17fe, State: Running, Role: LEADER
I20260808 05:04:51.357475 28719 consensus_queue.cc:237] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } }
I20260808 05:04:51.358348 27980 catalog_manager.cc:5495] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ec2459818d849339e21817fcfbb17fe (127.11.70.195). New cstate: current_term: 1 leader_uuid: "4ec2459818d849339e21817fcfbb17fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ec2459818d849339e21817fcfbb17fe" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 } health_report { overall_health: UNKNOWN } } }
I20260808 05:04:51.362371 28694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.348085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:46479 (local address 127.11.70.195:51855)
0808 05:04:51.352331 (+ 4246us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:51.352341 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:04:51.352379 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:04:51.359227 (+ 6848us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:04:51.359228 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:04:51.359230 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:04:51.359266 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.359267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.360417 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.360418 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.361477 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:04:51.361479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.362171 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.362172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:04:51.362224 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.362227 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:04:51.362272 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:04:51.362305 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4235,"thread_start_us":132,"threads_started":1}
I20260808 05:04:51.362735 28710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.348524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:51855 (local address 127.11.70.194:46479)
0808 05:04:51.348640 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:51.348642 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:51.352745 (+ 4103us) server_negotiation.cc:407] Connection header received
0808 05:04:51.352780 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:51.352781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:51.352793 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:51.352843 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:04:51.359357 (+ 6514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.360124 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.361578 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.362060 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.362129 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.362138 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:51.362592 (+ 454us) server_negotiation.cc:299] Negotiation successful
0808 05:04:51.362632 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 05:04:51.363279 28433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13e1b19e20cc4e50897b5e481dc87647" candidate_uuid: "4ec2459818d849339e21817fcfbb17fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" is_pre_election: true
I20260808 05:04:51.363432 28433 raft_consensus.cc:2454] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ec2459818d849339e21817fcfbb17fe in term 0.
I20260808 05:04:51.363564 28432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13e1b19e20cc4e50897b5e481dc87647" candidate_uuid: "4ec2459818d849339e21817fcfbb17fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7"
I20260808 05:04:51.363641 28432 raft_consensus.cc:3037] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:04:51.364562 28432 raft_consensus.cc:2454] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ec2459818d849339e21817fcfbb17fe in term 1.
I20260808 05:04:51.408808 28712 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.401456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38370 (local address 127.11.70.195:40459)
0808 05:04:51.401504 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:04:51.401506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:04:51.401520 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:04:51.401569 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:04:51.401570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:04:51.401595 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:04:51.401685 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:04:51.401870 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.402654 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.403761 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:04:51.404052 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:04:51.404122 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:04:51.404355 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:04:51.404497 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:04:51.404586 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 05:04:51.404848 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 05:04:51.404871 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:04:51.411298 28432 raft_consensus.cc:1261] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [term 1 FOLLOWER]: Refusing update from remote peer 4ec2459818d849339e21817fcfbb17fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:04:51.411907 28730 consensus_queue.cc:1035] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae6de7e4a8714d0089b55c8cfdb87df7" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46479 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:04:51.414703 28209 raft_consensus.cc:1261] T 13e1b19e20cc4e50897b5e481dc87647 P e098d1fe27734938888f5e9c213671ba [term 1 FOLLOWER]: Refusing update from remote peer 4ec2459818d849339e21817fcfbb17fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:04:51.415086 28730 consensus_queue.cc:1035] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "e098d1fe27734938888f5e9c213671ba" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 43863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:04:51.419095 28734 mvcc.cc:205] Tried to move back new op lower bound from 7316133852817383424 to 7316133852600791040. Current Snapshot: MvccSnapshot[applied={T|T < 7316133852817383424}]
I20260808 05:04:51.419683 28738 mvcc.cc:205] Tried to move back new op lower bound from 7316133852817383424 to 7316133852600791040. Current Snapshot: MvccSnapshot[applied={T|T < 7316133852817383424}]
I20260808 05:04:51.422199 27980 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:04:51.422299 27980 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57950:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:04:51.423061 27980 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0ca7306b82814238a1f6a84476204617: Sending DeleteTablet for 3 replicas of tablet 13e1b19e20cc4e50897b5e481dc87647
I20260808 05:04:51.423498 28181 tablet_service.cc:1514] Processing DeleteTablet for tablet 13e1b19e20cc4e50897b5e481dc87647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:04:51 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:46498
I20260808 05:04:51.423595 28402 tablet_service.cc:1514] Processing DeleteTablet for tablet 13e1b19e20cc4e50897b5e481dc87647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:04:51 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:57318
I20260808 05:04:51.423940 28593 tablet_service.cc:1514] Processing DeleteTablet for tablet 13e1b19e20cc4e50897b5e481dc87647 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:04:51 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:38362
I20260808 05:04:51.424233 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 28098
I20260808 05:04:51.424778 28735 mvcc.cc:205] Tried to move back new op lower bound from 7316133852817383424 to 7316133852600791040. Current Snapshot: MvccSnapshot[applied={T|T < 7316133852817383424}]
I20260808 05:04:51.426789 28744 tablet_replica.cc:330] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: stopping tablet replica
I20260808 05:04:51.426905 28744 raft_consensus.cc:2229] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:04:51.426991 28744 raft_consensus.cc:2258] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:04:51.435979 28744 ts_tablet_manager.cc:1905] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:04:51.437785 28744 ts_tablet_manager.cc:1918] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:04:51.437879 28744 log.cc:1196] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/13e1b19e20cc4e50897b5e481dc87647
I20260808 05:04:51.438177 28744 ts_tablet_manager.cc:1939] T 13e1b19e20cc4e50897b5e481dc87647 P ae6de7e4a8714d0089b55c8cfdb87df7: Deleting consensus metadata
I20260808 05:04:51.439255 27959 catalog_manager.cc:4841] TS ae6de7e4a8714d0089b55c8cfdb87df7 (127.11.70.194:46479): tablet 13e1b19e20cc4e50897b5e481dc87647 (table test-table [id=68f30c7f8235474cbe53bb09e08660aa]) successfully deleted
W20260808 05:04:51.446579 27957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:43863 (error 108)
I20260808 05:04:51.447225 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 28303
I20260808 05:04:51.448988 28745 tablet_replica.cc:330] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: stopping tablet replica
I20260808 05:04:51.449110 28745 raft_consensus.cc:2229] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:04:51.449249 28745 raft_consensus.cc:2258] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:04:51.464457 28745 ts_tablet_manager.cc:1905] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:04:51.466312 28745 ts_tablet_manager.cc:1918] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:04:51.466390 28745 log.cc:1196] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/13e1b19e20cc4e50897b5e481dc87647
I20260808 05:04:51.467466 28709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:04:51.467305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:43863 (local address 127.0.0.1:46514)
0808 05:04:51.467358 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 05:04:51.467416 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:43863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 05:04:51.467600 27957 catalog_manager.cc:4584] TS e098d1fe27734938888f5e9c213671ba (127.11.70.193:43863): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 13e1b19e20cc4e50897b5e481dc87647: Network error: Client connection negotiation failed: client connection to 127.11.70.193:43863: connect: Connection refused (error 111)
I20260808 05:04:51.468116 28745 ts_tablet_manager.cc:1939] T 13e1b19e20cc4e50897b5e481dc87647 P 4ec2459818d849339e21817fcfbb17fe: Deleting consensus metadata
I20260808 05:04:51.468588 27959 catalog_manager.cc:4841] TS 4ec2459818d849339e21817fcfbb17fe (127.11.70.195:40459): tablet 13e1b19e20cc4e50897b5e481dc87647 (table test-table [id=68f30c7f8235474cbe53bb09e08660aa]) successfully deleted
I20260808 05:04:51.470234 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 28500
I20260808 05:04:51.483211 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 27935
I20260808 05:04:51.497982 11547 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 05:04:51.842243 11547 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 05:04:51.842351 11547 mini_ranger.cc:66] Stopping Ranger...
I20260808 05:04:52.197154 11547 mini_ranger.cc:68] Stopped Ranger
2026-08-08 05:04:52.197 UTC [27346] LOG: received smart shutdown request
2026-08-08 05:04:52.200 UTC [27346] LOG: background worker "logical replication launcher" (PID 27358) exited with exit code 1
2026-08-08 05:04:52.201 UTC [27352] LOG: shutting down
2026-08-08 05:04:52.364 UTC [27346] LOG: database system is shut down
2026-08-08T05:04:52Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47186 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:04:52 dist-test-slave-7kzw krb5kdc[28760](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:04:52 dist-test-slave-7kzw krb5kdc[28760](info): set up 2 sockets
Aug 08 05:04:52 dist-test-slave-7kzw krb5kdc[28760](info): commencing operation
krb5kdc: starting...
W20260808 05:04:53.736244 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:04:53 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165493, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:04:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:04:53Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.11.70.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.11.70.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/rangeradmin_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/rangeradmin_127.11.70.212@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.11.70.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.11.70.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/rangerlookup_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/rangerlookup_127.11.70.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.70.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.11.70.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/HTTP_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/HTTP_127.11.70.212@KRBTEST.COM.keytab.
I20260808 05:04:53.909467 11547 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJXTM0Z/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/postgres -l logfile start
2026-08-08 05:04:56.363 UTC [28805] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 05:04:56.363 UTC [28805] LOG: listening on IPv4 address "127.11.70.212", port 54173
2026-08-08 05:04:56.367 UTC [28805] LOG: listening on Unix socket "/tmp/.s.PGSQL.54173"
2026-08-08 05:04:56.403 UTC [28808] LOG: database system was shut down at 2026-08-08 05:04:54 UTC
2026-08-08 05:04:56.406 UTC [28805] LOG: database system is ready to accept connections
I20260808 05:04:57.538733 11547 mini_postgres.cc:96] Postgres bound to 54173
2026-08-08 05:04:57.545 UTC [28822] FATAL: database "slave" does not exist
127.11.70.212:54173 - accepting connections
I20260808 05:04:57.546576 11547 mini_ranger.cc:161] Starting Ranger...
I20260808 05:04:57.561944 11547 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 05:04:58.016464 11547 mini_ranger.cc:87] Created ranger Postgres database
I20260808 05:04:58.016571 11547 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-admin
2026-08-08 05:04:58,312 [I] DB FLAVOR :POSTGRES
2026-08-08 05:04:58,312 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:04:58,313 [I] Checking connection..
2026-08-08 05:04:58,313 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 05:04:58,570 [I] Checking connection passed.
2026-08-08 05:04:58,570 [I] --------- Verifying version history table ---------
2026-08-08 05:04:58,571 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:04:58,842 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:04:58,842 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:04:59,129 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:04:59,129 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 05:04:59,129 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 05:04:59.387 UTC [28906] WARNING: there is no transaction in progress
2026-08-08 05:04:59,395 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 05:04:59,395 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:04:59,641 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 05:04:59,642 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:04:59,642 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 05:04:59,914 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 05:05:00,182 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-7kzw.c.gcp-upstream.internal','N') ;"
2026-08-08 05:05:00,437 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:05:00,712 [I] Table x_portal_user does not exist in database ranger
2026-08-08 05:05:00,712 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:05:00,962 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 05:05:00,962 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:05:01,230 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:05:01,495 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 05:05:01,495 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 05:05:02.455 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.470 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.486 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.501 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.518 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.538 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.600 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.608 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.623 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.633 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.643 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.657 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.668 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.675 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.682 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:02.689 UTC [29056] WARNING: there is no transaction in progress
2026-08-08 05:05:03,327 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 05:05:03,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 05:05:03,588 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 05:05:03,589 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:05:03,849 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 05:05:03,849 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:05:04,121 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 05:05:04,121 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:05:04,384 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:05:04,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-7kzw.c.gcp-upstream.internal';"
2026-08-08 05:05:04,877 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 05:05:04,877 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 05:05:05,121 [I] DB_PATCHES have already been applied
I20260808 05:05:05.128274 11547 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJXTM0Z/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 05:05:05.128430 11547 mini_ranger.cc:193] Using host: 127.11.70.212
I20260808 05:05:05.132925 11547 mini_ranger.cc:227] Ranger admin URL: http://127.11.70.212:50717
Aug 08, 2026 5:05:05 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:05:05 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:05:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:05:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:05:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:05:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:05:06 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 05:05:06.514277 11547 mini_ranger.cc:160] Time spent starting Ranger: real 8.968s user 0.000s sys 0.011s
Aug 08, 2026 5:05:27 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:05:27 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 08, 2026 5:05:27 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:05:27 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:05:28 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 05:05:28.799153 11547 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.11.70.212@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.11.70.212@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/rangerkms_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.11.70.212@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/rangerkms_127.11.70.212@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.11.70.212@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.11.70.212@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.11.70.212@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/HTTP_127.11.70.212@KRBTEST.COM.keytab.
Entry for principal HTTP/127.11.70.212@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/HTTP_127.11.70.212@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 05:05:28 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165528, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 05:05:28.907891 11547 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 05:05:28.919760 11547 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 05:05:29.806394 11547 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 05:05:29.806528 11547 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-kms
I20260808 05:05:29.806551 11547 mini_ranger_kms.cc:227] Using postgres at 127.11.70.212:54173
2026-08-08 05:05:30,000 [I] DB FLAVOR :POSTGRES
2026-08-08 05:05:30,000 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:05:30,000 [I] Checking connection
2026-08-08 05:05:30,000 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 05:05:30,253 [I] connection success
2026-08-08 05:05:30,253 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 05:05:30,253 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 05:05:30,253 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 05:05:30,502 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 05:05:30,502 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:05:30,502 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 05:05:30,502 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.11.70.212:54173/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 05:05:30,771 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 05:05:31.255051 11547 mini_ranger_kms.cc:310] Created kms service
I20260808 05:05:31.435431 11547 mini_ranger_kms.cc:326] Created kudu user
I20260808 05:05:31.482893 11547 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 05:05:31 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165528, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:31.876777 11547 mini_ranger_kms.cc:384] Added ranger policy
I20260808 05:05:31.876997 11547 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJXTM0Z/build/release/bin/postgresql.jar:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJXTM0Z/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 05:05:31.877027 11547 mini_ranger_kms.cc:240] Using host: 127.11.70.212
I20260808 05:05:31.881695 11547 mini_ranger_kms.cc:276] Ranger KMS PID: 29333
I20260808 05:05:31.881781 11547 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.11.70.212:52975
Aug 08, 2026 5:05:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:05:33 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:05:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:05:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:05:33 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:05:33 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 05:05:34 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165534, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.70.212@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:34.666069 11547 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.758s user 0.000s sys 0.177s
I20260808 05:05:34.666191 11547 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 05:05:34.666254 11547 mini_ranger_kms.cc:401] 127.11.70.212:52975/kms/v1/keys
Aug 08 05:05:34 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165534, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.70.212@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
Aug 08 05:05:35 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165534, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.11.70.212@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
Aug 08 05:05:37 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:05:37.475428 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:46631
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:46631
--ranger_config_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:52975/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:37.562755 29401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:37.562959 29401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:37.562983 29401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:37.564090 29401 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:05:37.564133 29401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:37.564149 29401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:37.564164 29401 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:05:37.564178 29401 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:05:37.565747 29401 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
--ranger_kms_url=127.11.70.212:52975/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:46631
--ranger_config_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:46631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:37.565943 29401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:37.566123 29401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:37.571534 29409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:37.571575 29412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:37.571594 29401 server_base.cc:1034] running on GCE node
W20260808 05:05:37.571542 29410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:37.572239 29401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:37.572495 29401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:37.573685 29401 hybrid_clock.cc:648] HybridClock initialized: now 1786165537573682 us; error 55 us; skew 500 ppm
Aug 08 05:05:37 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165537, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:37.580674 29401 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:05:37.581074 29401 webserver.cc:460] Webserver started at http://127.11.70.254:37127/ using document root <none> and password file <none>
I20260808 05:05:37.581323 29401 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:37.581367 29401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:37.581511 29401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:05:37 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165537, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:37.630147 29401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "4be1e7d1e56f46ff8a892936e6d1a919"
format_stamp: "Formatted at 2026-08-08 05:05:37 on dist-test-slave-7kzw"
server_key: "16c8bf82962ea9c18a101b2eb2ae9457"
server_key_iv: "7a0a8d8f1b78da22fd743b73d27597c4"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:37.630589 29401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "4be1e7d1e56f46ff8a892936e6d1a919"
format_stamp: "Formatted at 2026-08-08 05:05:37 on dist-test-slave-7kzw"
server_key: "16c8bf82962ea9c18a101b2eb2ae9457"
server_key_iv: "7a0a8d8f1b78da22fd743b73d27597c4"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:37.632229 29401 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:37.647948 29422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:37.648207 29401 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:37.648351 29401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "4be1e7d1e56f46ff8a892936e6d1a919"
format_stamp: "Formatted at 2026-08-08 05:05:37 on dist-test-slave-7kzw"
server_key: "16c8bf82962ea9c18a101b2eb2ae9457"
server_key_iv: "7a0a8d8f1b78da22fd743b73d27597c4"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:37.648458 29401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:37.659209 29401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:37.661741 29401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:37.661917 29401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:37.668385 29401 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:46631
I20260808 05:05:37.668898 29401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:05:37.669093 29493 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:46631 every 8 connection(s)
I20260808 05:05:37.670151 29494 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:37.671890 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 29401
I20260808 05:05:37.672001 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:05:37.672222 11547 external_mini_cluster.cc:1428] Setting key 3ce295a8bc0483eba03a31049884be7d
I20260808 05:05:37.673193 29494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Bootstrap starting.
I20260808 05:05:37.673909 29494 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:37.674279 29494 log.cc:824] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:37.675125 29494 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: No bootstrap required, opened a new log
I20260808 05:05:37.677778 29494 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } }
I20260808 05:05:37.677950 29494 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:37.677992 29494 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be1e7d1e56f46ff8a892936e6d1a919, State: Initialized, Role: FOLLOWER
I20260808 05:05:37.678121 29494 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } }
I20260808 05:05:37.678205 29494 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:05:37.678227 29494 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:05:37.678294 29494 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:37.678896 29494 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } }
I20260808 05:05:37.678988 29494 leader_election.cc:302] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4be1e7d1e56f46ff8a892936e6d1a919; no voters:
I20260808 05:05:37.679186 29494 leader_election.cc:288] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:05:37.679239 29500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:05:37.679443 29500 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 1 LEADER]: Becoming Leader. State: Replica: 4be1e7d1e56f46ff8a892936e6d1a919, State: Running, Role: LEADER
I20260808 05:05:37.679503 29494 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:05:37.679610 29500 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } }
Aug 08 05:05:37 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165537, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:37.679943 29500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } } }
I20260808 05:05:37.680032 29500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:37.680238 29500 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4be1e7d1e56f46ff8a892936e6d1a919. Latest consensus state: current_term: 1 leader_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } } }
I20260808 05:05:37.680330 29500 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:37.680476 29511 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:05:37.681006 29511 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:05:37.681298 29494 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 05:05:37.687932 29511 catalog_manager.cc:1347] Generated new cluster ID: 4e42a7aa96534188bdac4a44d07c9950
I20260808 05:05:37.688071 29511 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:05:37.688283 29497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:37.672794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37670 (local address 127.11.70.254:46631)
0808 05:05:37.673048 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:37.673056 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:37.673081 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:05:37.673560 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:37.673568 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:37.673617 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:37.673733 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:37.674649 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:37.675828 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:37.676970 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:37.677364 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:37.677451 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:37.680294 (+ 2843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:37.680299 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:37.680300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:37.680316 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:37.685605 (+ 5289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:37.686090 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:37.686096 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:37.686096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:37.686210 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:37.686458 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:37.686458 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:37.686458 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:37.686978 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:37.687623 (+ 645us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:37.687707 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 05:05:37.688068 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":84,"threads_started":1}
I20260808 05:05:37.697724 29511 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:05:37.698518 29511 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:05:37.701424 29511 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Generated new TSK 0
I20260808 05:05:37.701654 29511 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:05:38.377635 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:52975/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:46631
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:38.490675 29550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:38.491030 29550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:38.491094 29550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:38.492250 29550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:38.492324 29550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:38.492372 29550 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:05:38.493981 29550 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.11.70.212:52975/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:46631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:38.494257 29550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:38.494554 29550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:38.501132 29558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:38.501142 29564 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:38.501142 29560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:38.501523 29550 server_base.cc:1034] running on GCE node
I20260808 05:05:38.501782 29550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:38.502048 29550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:38.503206 29550 hybrid_clock.cc:648] HybridClock initialized: now 1786165538503184 us; error 39 us; skew 500 ppm
Aug 08 05:05:38 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165538, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:38.506018 29550 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:05:38.506613 29550 webserver.cc:460] Webserver started at http://127.11.70.193:43375/ using document root <none> and password file <none>
I20260808 05:05:38.506904 29550 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:38.506985 29550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:38.507165 29550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:05:38 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165538, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:38.528136 29550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "6767a3a09df94ba7bef696c1aca5f8b2"
format_stamp: "Formatted at 2026-08-08 05:05:38 on dist-test-slave-7kzw"
server_key: "bb926a445f36394e82db01e6685b5d6d"
server_key_iv: "28b2e658c6621647abcb1f5c74faca28"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:38.529448 29550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "6767a3a09df94ba7bef696c1aca5f8b2"
format_stamp: "Formatted at 2026-08-08 05:05:38 on dist-test-slave-7kzw"
server_key: "bb926a445f36394e82db01e6685b5d6d"
server_key_iv: "28b2e658c6621647abcb1f5c74faca28"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:38.531669 29550 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260808 05:05:38.550631 29578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:38.551054 29550 fs_manager.cc:725] Time spent opening block manager: real 0.005s user 0.001s sys 0.001s
I20260808 05:05:38.551190 29550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "6767a3a09df94ba7bef696c1aca5f8b2"
format_stamp: "Formatted at 2026-08-08 05:05:38 on dist-test-slave-7kzw"
server_key: "bb926a445f36394e82db01e6685b5d6d"
server_key_iv: "28b2e658c6621647abcb1f5c74faca28"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:38.551312 29550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:38.578593 29550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:38.581122 29550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:38.581319 29550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:38.581636 29550 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:38.582101 29550 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:38.582165 29550 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:38.582249 29550 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:38.582305 29550 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:38.590737 29550 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:40821
I20260808 05:05:38.591236 29550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:05:38.592952 29745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:40821 every 8 connection(s)
I20260808 05:05:38.598176 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 29550
I20260808 05:05:38.598322 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:05:38.598603 11547 external_mini_cluster.cc:1428] Setting key 91b8406e751c1364a8f12bcc42717747
Aug 08 05:05:38 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165538, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:38.608839 29749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:38.592650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:46631 (local address 127.11.70.193:58411)
0808 05:05:38.593347 (+ 697us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:38.593392 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:38.594610 (+ 1218us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:38.597568 (+ 2958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:38.597573 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:38.597873 (+ 300us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:38.598209 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:38.598217 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:38.599629 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:38.599630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:38.601097 (+ 1467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:38.601101 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:38.601723 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:38.601724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:38.601911 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:38.602623 (+ 712us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:38.602635 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:38.604551 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:38.606932 (+ 2381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:38.606941 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:38.606943 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:38.607300 (+ 357us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:38.607557 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:38.607558 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:38.607558 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:38.607720 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:38.608067 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:38.608074 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:38.608252 (+ 178us) client_negotiation.cc:769] Sending connection context
0808 05:05:38.608379 (+ 127us) client_negotiation.cc:240] Negotiation successful
0808 05:05:38.608552 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":653,"thread_start_us":108,"threads_started":1}
I20260808 05:05:38.609562 29748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:38.592417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:58411 (local address 127.11.70.254:46631)
0808 05:05:38.593279 (+ 862us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:38.593281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:38.593762 (+ 481us) server_negotiation.cc:407] Connection header received
0808 05:05:38.594822 (+ 1060us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:38.594824 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:38.594842 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:38.594921 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:38.598521 (+ 3600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:38.599484 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:38.601209 (+ 1725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:38.601561 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:38.601631 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:38.604694 (+ 3063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:38.604695 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:38.604696 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:38.604704 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:38.606820 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:38.607401 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:38.607403 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:38.607403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:38.607481 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:38.607816 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:38.607817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:38.607818 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:38.607966 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:38.608036 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:38.609339 (+ 1303us) server_negotiation.cc:299] Negotiation successful
0808 05:05:38.609442 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":826,"thread_start_us":102,"threads_started":1}
I20260808 05:05:38.610407 29746 heartbeater.cc:347] Connected to a master server at 127.11.70.254:46631
I20260808 05:05:38.610548 29746 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:38.610778 29746 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
I20260808 05:05:38.611433 29447 ts_manager.cc:194] Registered new tserver with Master: 6767a3a09df94ba7bef696c1aca5f8b2 (127.11.70.193:40821)
I20260808 05:05:38.612428 29447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:58411
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:05:38.644029 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:52975/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:46631
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:05:38 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165538, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 05:05:38.781205 29756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:38.781507 29756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:38.781549 29756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:38.783437 29756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:38.783499 29756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:38.783543 29756 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:05:38.785910 29756 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.11.70.212:52975/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:46631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:38.786188 29756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:38.786504 29756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:38.793336 29768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:38.793342 29770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:38.793550 29767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:38.794016 29756 server_base.cc:1034] running on GCE node
I20260808 05:05:38.794255 29756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:38.794570 29756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:38.795773 29756 hybrid_clock.cc:648] HybridClock initialized: now 1786165538795748 us; error 37 us; skew 500 ppm
Aug 08 05:05:38 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165538, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:38.799402 29756 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:05:38.800014 29756 webserver.cc:460] Webserver started at http://127.11.70.194:42177/ using document root <none> and password file <none>
I20260808 05:05:38.800339 29756 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:38.800420 29756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:38.800570 29756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:05:38 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165538, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:38.816032 29756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "b90fb6e29be24a3a9d6e274f35663ac6"
format_stamp: "Formatted at 2026-08-08 05:05:38 on dist-test-slave-7kzw"
server_key: "fe7bedf81b9038fd19d43212155e7547"
server_key_iv: "49c5555b65fcc8788efecd2c7e88d9c5"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:38.816648 29756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "b90fb6e29be24a3a9d6e274f35663ac6"
format_stamp: "Formatted at 2026-08-08 05:05:38 on dist-test-slave-7kzw"
server_key: "fe7bedf81b9038fd19d43212155e7547"
server_key_iv: "49c5555b65fcc8788efecd2c7e88d9c5"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:38.822657 29756 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.000s
I20260808 05:05:38.846904 29780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:38.847203 29756 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260808 05:05:38.847383 29756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "b90fb6e29be24a3a9d6e274f35663ac6"
format_stamp: "Formatted at 2026-08-08 05:05:38 on dist-test-slave-7kzw"
server_key: "fe7bedf81b9038fd19d43212155e7547"
server_key_iv: "49c5555b65fcc8788efecd2c7e88d9c5"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:38.847553 29756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:38.864259 29756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:38.866906 29756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:38.867115 29756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:38.867443 29756 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:38.867878 29756 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:38.867977 29756 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:38.868055 29756 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:38.868116 29756 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:38.876964 29756 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:42359
I20260808 05:05:38.877527 29756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:05:38.878106 29938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:42359 every 8 connection(s)
I20260808 05:05:38.882541 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 29756
I20260808 05:05:38.882670 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:05:38.882900 11547 external_mini_cluster.cc:1428] Setting key d451c7d231ba12d733fe18383f745f6d
Aug 08 05:05:38 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165538, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:38.890304 29748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:38.879275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:55823 (local address 127.11.70.254:46631)
0808 05:05:38.879345 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:38.879348 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:38.879665 (+ 317us) server_negotiation.cc:407] Connection header received
0808 05:05:38.880516 (+ 851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:38.880518 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:38.880534 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:38.880565 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:38.881501 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:38.882325 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:38.883840 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:38.884149 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:38.884205 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:38.886905 (+ 2700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:38.886906 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:38.886906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:38.886914 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:38.888710 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:38.889205 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:38.889207 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:38.889207 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:38.889267 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:38.889549 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:38.889550 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:38.889550 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:38.889684 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:38.889726 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:38.890100 (+ 374us) server_negotiation.cc:299] Negotiation successful
0808 05:05:38.890204 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:05:38.890875 29943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:38.878940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:46631 (local address 127.11.70.194:55823)
0808 05:05:38.879529 (+ 589us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:38.879574 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:38.880396 (+ 822us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:38.880745 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:38.880749 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:38.881096 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:38.881392 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:38.881398 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:38.882445 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:38.882446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:38.883736 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:38.883740 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:38.884311 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:38.884312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:38.884458 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:38.885085 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:38.885096 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:38.886784 (+ 1688us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:38.888807 (+ 2023us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:38.888814 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:38.888816 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:38.889100 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:38.889339 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:38.889340 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:38.889340 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:38.889474 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:38.889772 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:38.889778 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:38.889933 (+ 155us) client_negotiation.cc:769] Sending connection context
0808 05:05:38.890445 (+ 512us) client_negotiation.cc:240] Negotiation successful
0808 05:05:38.890635 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":104,"threads_started":1}
I20260808 05:05:38.891330 29939 heartbeater.cc:347] Connected to a master server at 127.11.70.254:46631
I20260808 05:05:38.891431 29939 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:38.891624 29939 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
I20260808 05:05:38.892011 29447 ts_manager.cc:194] Registered new tserver with Master: b90fb6e29be24a3a9d6e274f35663ac6 (127.11.70.194:42359)
I20260808 05:05:38.892613 29447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:55823
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:05:38.925266 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:52975/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:46631
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:39.060061 29946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:39.060374 29946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:39.060431 29946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:39.062170 29946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:39.062238 29946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:39.062289 29946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:05:39.064525 29946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.11.70.212:52975/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:46631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:39.064803 29946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:39.065107 29946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:39.072242 29956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:39.072340 29955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:39.072717 29958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:39.073271 29946 server_base.cc:1034] running on GCE node
I20260808 05:05:39.073494 29946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:39.073793 29946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:39.074992 29946 hybrid_clock.cc:648] HybridClock initialized: now 1786165539074963 us; error 44 us; skew 500 ppm
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:39.078680 29946 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:05:39.079281 29946 webserver.cc:460] Webserver started at http://127.11.70.195:42019/ using document root <none> and password file <none>
I20260808 05:05:39.079680 29946 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:39.079764 29946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:39.079926 29946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:39.100983 29946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "d583254623fa42549bcd437514ba81b6"
format_stamp: "Formatted at 2026-08-08 05:05:39 on dist-test-slave-7kzw"
server_key: "065b082322b2d1d15a207eae52c862f7"
server_key_iv: "4c761b114ba667202d6ed854f20ac8af"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:39.101576 29946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "d583254623fa42549bcd437514ba81b6"
format_stamp: "Formatted at 2026-08-08 05:05:39 on dist-test-slave-7kzw"
server_key: "065b082322b2d1d15a207eae52c862f7"
server_key_iv: "4c761b114ba667202d6ed854f20ac8af"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:39.116817 29946 fs_manager.cc:691] Time spent creating directory manager: real 0.015s user 0.002s sys 0.000s
I20260808 05:05:39.137738 29968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.137953 29946 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.000s sys 0.000s
I20260808 05:05:39.138082 29946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "d583254623fa42549bcd437514ba81b6"
format_stamp: "Formatted at 2026-08-08 05:05:39 on dist-test-slave-7kzw"
server_key: "065b082322b2d1d15a207eae52c862f7"
server_key_iv: "4c761b114ba667202d6ed854f20ac8af"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:39.138203 29946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:39.165328 29946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:39.167968 29946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:39.168159 29946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:39.168401 29946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:39.168803 29946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:39.168845 29946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.168876 29946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:39.168895 29946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.176481 29946 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:42523
I20260808 05:05:39.176926 29946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:05:39.179817 30143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:42523 every 8 connection(s)
I20260808 05:05:39.184579 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 29946
I20260808 05:05:39.184696 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:05:39.184911 11547 external_mini_cluster.cc:1428] Setting key 2c7122090898fbfb700a548478e248dd
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:39.206138 29748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:39.180883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:35011 (local address 127.11.70.254:46631)
0808 05:05:39.180930 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:39.180933 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:39.181699 (+ 766us) server_negotiation.cc:407] Connection header received
0808 05:05:39.182427 (+ 728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:39.182428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:39.182442 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:39.182500 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:39.183396 (+ 896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.184216 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.187140 (+ 2924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.187461 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.187507 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:39.190449 (+ 2942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:39.190451 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:39.190451 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:39.190460 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:39.204193 (+ 13733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:39.204847 (+ 654us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:39.204848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:39.204849 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:39.204917 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:39.205284 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:39.205285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:39.205286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:39.205436 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:39.205484 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:39.205918 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 05:05:39.206021 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:05:39.207242 30148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:39.180556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:46631 (local address 127.11.70.195:35011)
0808 05:05:39.181559 (+ 1003us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:39.181605 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:39.182293 (+ 688us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:39.182706 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:39.182710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:39.182969 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:39.183276 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:39.183282 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.184342 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.184343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:39.187021 (+ 2678us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:39.187025 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.187622 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.187623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:39.187763 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:39.188424 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:39.188435 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:39.190331 (+ 1896us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:39.204350 (+ 14019us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:39.204364 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:39.204367 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:39.204743 (+ 376us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:39.204998 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:39.204999 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:39.204999 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:39.205191 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:39.205536 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:39.205544 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:39.205738 (+ 194us) client_negotiation.cc:769] Sending connection context
0808 05:05:39.206757 (+ 1019us) client_negotiation.cc:240] Negotiation successful
0808 05:05:39.206966 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":959,"thread_start_us":114,"threads_started":1}
I20260808 05:05:39.207967 30145 heartbeater.cc:347] Connected to a master server at 127.11.70.254:46631
I20260808 05:05:39.208084 30145 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:39.208294 30145 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
I20260808 05:05:39.208760 29447 ts_manager.cc:194] Registered new tserver with Master: d583254623fa42549bcd437514ba81b6 (127.11.70.195:42523)
I20260808 05:05:39.209292 29447 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:35011
I20260808 05:05:39.217494 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:05:39.218400 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 29550
I20260808 05:05:39.229148 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 29756
I20260808 05:05:39.239856 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 29946
I20260808 05:05:39.253715 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 29401
I20260808 05:05:39.273762 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:46631
--webserver_interface=127.11.70.254
--webserver_port=37127
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:46631
--ranger_config_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:52975/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.70.212:52975/kms with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:39.393880 30150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:39.394179 30150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:39.394212 30150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:39.395865 30150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:05:39.395927 30150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:39.395947 30150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:39.395964 30150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:05:39.395982 30150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:05:39.398156 30150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.70.212:52975/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:46631
--ranger_config_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:46631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=37127
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:39.398403 30150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:39.398679 30150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:39.404208 30163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:39.404219 30159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:39.404219 30160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:39.404462 30150 server_base.cc:1034] running on GCE node
I20260808 05:05:39.404726 30150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:39.405021 30150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:39.406194 30150 hybrid_clock.cc:648] HybridClock initialized: now 1786165539406169 us; error 39 us; skew 500 ppm
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:39.409111 30150 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:05:39.409623 30150 webserver.cc:460] Webserver started at http://127.11.70.254:37127/ using document root <none> and password file <none>
I20260808 05:05:39.409860 30150 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:39.409920 30150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:39.487800 30150 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:39.488730 30173 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.488969 30150 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:39.489084 30150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "4be1e7d1e56f46ff8a892936e6d1a919"
format_stamp: "Formatted at 2026-08-08 05:05:37 on dist-test-slave-7kzw"
server_key: "16c8bf82962ea9c18a101b2eb2ae9457"
server_key_iv: "7a0a8d8f1b78da22fd743b73d27597c4"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:39.489494 30150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:39.513286 30150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:39.515430 30150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:39.515606 30150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:39.520812 30150 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:46631
I20260808 05:05:39.520901 30250 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:46631 every 8 connection(s)
I20260808 05:05:39.521303 30150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:05:39.522719 30252 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:05:39.522981 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 30150
I20260808 05:05:39.523316 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:52975/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:40821
--local_ip_for_outbound_sockets=127.11.70.193
--tserver_master_addrs=127.11.70.254:46631
--webserver_port=43375
--webserver_interface=127.11.70.193
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.70.212:52975/kms with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:05:39.523721 30252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Bootstrap starting.
I20260808 05:05:39.533214 30252 log.cc:824] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:39.535161 30252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:05:39.535497 30252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Bootstrap complete.
I20260808 05:05:39.538164 30252 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } }
I20260808 05:05:39.538427 30252 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4be1e7d1e56f46ff8a892936e6d1a919, State: Initialized, Role: FOLLOWER
I20260808 05:05:39.538681 30252 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } }
I20260808 05:05:39.538786 30252 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:05:39.538856 30252 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:05:39.538931 30252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:05:39.539992 30252 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } }
I20260808 05:05:39.540146 30252 leader_election.cc:302] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4be1e7d1e56f46ff8a892936e6d1a919; no voters:
I20260808 05:05:39.540361 30252 leader_election.cc:288] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:05:39.540419 30257 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:05:39.540601 30257 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [term 2 LEADER]: Becoming Leader. State: Replica: 4be1e7d1e56f46ff8a892936e6d1a919, State: Running, Role: LEADER
I20260808 05:05:39.540704 30252 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:05:39.540757 30257 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } }
I20260808 05:05:39.541087 30257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } } }
I20260808 05:05:39.541232 30257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:39.541451 30257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4be1e7d1e56f46ff8a892936e6d1a919. Latest consensus state: current_term: 2 leader_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4be1e7d1e56f46ff8a892936e6d1a919" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 46631 } } }
I20260808 05:05:39.541574 30257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:39.541750 30271 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:05:39.542939 30271 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:05:39.543092 30271 catalog_manager.cc:1259] Loaded cluster ID: 4e42a7aa96534188bdac4a44d07c9950
I20260808 05:05:39.543134 30271 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:05:39.544297 30271 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:05:39.544490 30271 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Loaded TSK: 0
I20260808 05:05:39.544713 30271 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:05:39.545184 30252 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260808 05:05:39.645180 30255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:39.645531 30255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:39.645612 30255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:39.647460 30255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:39.647521 30255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:39.647558 30255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:05:39.649758 30255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.70.212:52975/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:40821
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=43375
--tserver_master_addrs=127.11.70.254:46631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:39.650003 30255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:39.650286 30255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:39.656836 30309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:39.657038 30306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:39.658560 30255 server_base.cc:1034] running on GCE node
W20260808 05:05:39.658797 30315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:39.659046 30255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:39.659327 30255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:39.669116 30255 hybrid_clock.cc:648] HybridClock initialized: now 1786165539669079 us; error 50 us; skew 500 ppm
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:39.674737 30255 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:05:39.675324 30255 webserver.cc:460] Webserver started at http://127.11.70.193:43375/ using document root <none> and password file <none>
I20260808 05:05:39.675618 30255 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:39.675697 30255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:39.701871 30255 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:05:39.702657 30328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.702821 30255 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:05:39.702939 30255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "6767a3a09df94ba7bef696c1aca5f8b2"
format_stamp: "Formatted at 2026-08-08 05:05:38 on dist-test-slave-7kzw"
server_key: "bb926a445f36394e82db01e6685b5d6d"
server_key_iv: "28b2e658c6621647abcb1f5c74faca28"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:39.703321 30255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:39.727447 30255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:39.729746 30255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:39.729940 30255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:39.730235 30255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:39.730633 30255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:39.730696 30255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.730739 30255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:39.730768 30255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.738490 30255 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:40821
I20260808 05:05:39.738914 30255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:05:39.739288 30507 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:40821 every 8 connection(s)
I20260808 05:05:39.744908 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 30255
I20260808 05:05:39.745316 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:52975/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:42359
--local_ip_for_outbound_sockets=127.11.70.194
--tserver_master_addrs=127.11.70.254:46631
--webserver_port=42177
--webserver_interface=127.11.70.194
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.70.212:52975/kms with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:39.757807 30511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:39.739898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:46631 (local address 127.11.70.193:41265)
0808 05:05:39.742398 (+ 2500us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:39.742437 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:39.743026 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:39.743517 (+ 491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:39.743522 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:39.743730 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:39.744019 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:39.744027 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.748589 (+ 4562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.748591 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:39.749880 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:39.749884 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.750884 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.750885 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:39.751040 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:39.751690 (+ 650us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:39.751701 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:39.753256 (+ 1555us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:39.755672 (+ 2416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:39.755681 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:39.755683 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:39.756001 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:39.756362 (+ 361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:39.756364 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:39.756364 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:39.756508 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:39.757018 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:39.757027 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:39.757192 (+ 165us) client_negotiation.cc:769] Sending connection context
0808 05:05:39.757312 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 05:05:39.757547 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2450,"thread_start_us":89,"threads_started":1}
I20260808 05:05:39.758934 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:39.739998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:41265 (local address 127.11.70.254:46631)
0808 05:05:39.742612 (+ 2614us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:39.742620 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:39.742676 (+ 56us) server_negotiation.cc:407] Connection header received
0808 05:05:39.743275 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:39.743280 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:39.743326 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:39.743462 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:39.744184 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.748442 (+ 4258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.749992 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.750726 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.751362 (+ 636us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:39.753393 (+ 2031us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:39.753398 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:39.753399 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:39.753411 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:39.755563 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:39.756133 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:39.756136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:39.756137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:39.756270 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:39.756590 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:39.756591 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:39.756591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:39.756917 (+ 326us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:39.758494 (+ 1577us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:39.758578 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 05:05:39.758717 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2547,"thread_start_us":68,"threads_started":1}
I20260808 05:05:39.759931 30509 heartbeater.cc:347] Connected to a master server at 127.11.70.254:46631
I20260808 05:05:39.760056 30509 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:39.760284 30509 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
W20260808 05:05:39.761235 30509 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:46631 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 05:05:39.761328 30509 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:39.761397 30509 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
I20260808 05:05:39.761824 30509 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:39.761904 30509 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
W20260808 05:05:39.762288 30509 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:05:39.858791 30513 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:39.859015 30513 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:39.859056 30513 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:39.860268 30513 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:39.860339 30513 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:39.860450 30513 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:05:39.862035 30513 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.70.212:52975/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:42359
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=42177
--tserver_master_addrs=127.11.70.254:46631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:39.862303 30513 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:39.862619 30513 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:39.868018 30526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:39.868876 30520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:39.869172 30513 server_base.cc:1034] running on GCE node
W20260808 05:05:39.869269 30522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:39.869661 30513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:39.869966 30513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:39.871157 30513 hybrid_clock.cc:648] HybridClock initialized: now 1786165539871123 us; error 45 us; skew 500 ppm
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:39.874398 30513 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:05:39.875020 30513 webserver.cc:460] Webserver started at http://127.11.70.194:42177/ using document root <none> and password file <none>
I20260808 05:05:39.875344 30513 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:39.875444 30513 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:39.892465 30513 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:05:39.893931 30536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.894162 30513 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:39.894302 30513 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "b90fb6e29be24a3a9d6e274f35663ac6"
format_stamp: "Formatted at 2026-08-08 05:05:38 on dist-test-slave-7kzw"
server_key: "fe7bedf81b9038fd19d43212155e7547"
server_key_iv: "49c5555b65fcc8788efecd2c7e88d9c5"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:39.894925 30513 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:39.940167 30513 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:39.942835 30513 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:39.943013 30513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:39.943257 30513 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:39.943653 30513 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:39.943708 30513 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.943754 30513 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:39.943781 30513 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:39.951397 30513 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:42359
I20260808 05:05:39.951511 30707 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:42359 every 8 connection(s)
I20260808 05:05:39.951941 30513 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:05:39.957729 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 30513
I20260808 05:05:39.958053 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.11.70.212:52975/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:42523
--local_ip_for_outbound_sockets=127.11.70.195
--tserver_master_addrs=127.11.70.254:46631
--webserver_port=42019
--webserver_interface=127.11.70.195
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:37457
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.11.70.212:52975/kms with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:05:39 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165539, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:39.962606 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:39.952840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:35583 (local address 127.11.70.254:46631)
0808 05:05:39.952950 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:39.952953 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:39.953228 (+ 275us) server_negotiation.cc:407] Connection header received
0808 05:05:39.953773 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:39.953775 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:39.953792 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:39.953849 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:39.954423 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.954963 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.956035 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.956265 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.956356 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:39.958895 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:39.958896 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:39.958897 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:39.958904 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:39.960840 (+ 1936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:39.961365 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:39.961366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:39.961367 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:39.961430 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:39.961731 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:39.961732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:39.961732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:39.961888 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:39.961935 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:39.962332 (+ 397us) server_negotiation.cc:299] Negotiation successful
0808 05:05:39.962425 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260808 05:05:39.963466 30710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:39.952816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:46631 (local address 127.11.70.194:35583)
0808 05:05:39.953101 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:39.953134 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:39.953660 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:39.953920 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:39.953924 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:39.954122 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:39.954323 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:39.954327 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.955070 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.955072 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:39.955948 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:39.955951 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:39.956391 (+ 440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:39.956392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:39.956531 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:39.957134 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:39.957144 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:39.958777 (+ 1633us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:39.960937 (+ 2160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:39.960945 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:39.960948 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:39.961271 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:39.961505 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:39.961506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:39.961506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:39.961640 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:39.961987 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:39.961994 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:39.962168 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 05:05:39.962984 (+ 816us) client_negotiation.cc:240] Negotiation successful
0808 05:05:39.963169 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":115,"threads_started":1}
I20260808 05:05:39.964303 30708 heartbeater.cc:347] Connected to a master server at 127.11.70.254:46631
I20260808 05:05:39.964425 30708 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:39.964644 30708 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
W20260808 05:05:39.966212 30708 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:46631 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 05:05:39.966302 30708 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:39.966391 30708 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
I20260808 05:05:39.966826 30708 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:39.966914 30708 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
W20260808 05:05:39.967283 30708 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:05:40.080183 30711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:40.080618 30711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:40.080744 30711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:40.082715 30711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:40.082806 30711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:40.082858 30711 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:05:40.084558 30711 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37457
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.11.70.212:52975/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:42523
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=42019
--tserver_master_addrs=127.11.70.254:46631
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:40.084873 30711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:40.085151 30711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:40.090765 30721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:40.090895 30718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:40.091938 30711 server_base.cc:1034] running on GCE node
W20260808 05:05:40.092272 30719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:40.092679 30711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:40.093020 30711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:40.096344 30711 hybrid_clock.cc:648] HybridClock initialized: now 1786165540096320 us; error 34 us; skew 500 ppm
Aug 08 05:05:40 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165540, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:40.099730 30711 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:05:40.100277 30711 webserver.cc:460] Webserver started at http://127.11.70.195:42019/ using document root <none> and password file <none>
I20260808 05:05:40.100544 30711 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:40.100648 30711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:05:40 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165540, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:40.114988 30711 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:40.116204 30732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:40.116379 30711 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:40.116466 30711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "d583254623fa42549bcd437514ba81b6"
format_stamp: "Formatted at 2026-08-08 05:05:39 on dist-test-slave-7kzw"
server_key: "065b082322b2d1d15a207eae52c862f7"
server_key_iv: "4c761b114ba667202d6ed854f20ac8af"
server_key_version: "kuduclusterkey@0"
I20260808 05:05:40.116989 30711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:40.137264 30711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:40.139554 30711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:40.139740 30711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:40.140020 30711 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:40.140488 30711 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:40.140547 30711 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:40.140617 30711 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:40.140648 30711 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:40.148408 30711 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:42523
I20260808 05:05:40.148495 30896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:42523 every 8 connection(s)
I20260808 05:05:40.148849 30711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:05:40.153119 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 30711
Aug 08 05:05:40 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165540, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:40.159934 30512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:40.149698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:33571 (local address 127.11.70.254:46631)
0808 05:05:40.149751 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:40.149753 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:40.150086 (+ 333us) server_negotiation.cc:407] Connection header received
0808 05:05:40.150775 (+ 689us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:40.150777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:40.150791 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:40.150882 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:40.151416 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:40.152178 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:40.153588 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:40.153918 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:40.154007 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:40.156600 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:40.156602 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:40.156602 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:40.156610 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:40.158250 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:40.158767 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:40.158769 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:40.158769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:40.158839 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:40.159201 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:40.159202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:40.159202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:40.159337 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:40.159392 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:40.159744 (+ 352us) server_negotiation.cc:299] Negotiation successful
0808 05:05:40.159841 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:05:40.160106 30904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:40.149680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:46631 (local address 127.11.70.195:33571)
0808 05:05:40.149938 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:40.149981 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:40.150647 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:40.150934 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:40.150937 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:40.151116 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:40.151319 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:40.151323 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:40.152303 (+ 980us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:40.152304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:40.153489 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:40.153492 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:40.154044 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:40.154045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:40.154190 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:40.154867 (+ 677us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:40.154876 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:40.156490 (+ 1614us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:40.158356 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:40.158365 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:40.158368 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:40.158709 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:40.158945 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:40.158946 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:40.158946 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:40.159099 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:40.159432 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:40.159440 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:40.159588 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 05:05:40.159698 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 05:05:40.159853 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":89,"threads_started":1}
I20260808 05:05:40.160666 30900 heartbeater.cc:347] Connected to a master server at 127.11.70.254:46631
I20260808 05:05:40.160768 30900 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:40.160969 30900 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
W20260808 05:05:40.161667 30900 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:46631 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 05:05:40.161738 30900 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:40.161799 30900 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
I20260808 05:05:40.162184 30900 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:40.162261 30900 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
W20260808 05:05:40.162629 30900 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:05:40.168247 30906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:40.154084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37676 (local address 127.11.70.254:46631)
0808 05:05:40.154447 (+ 363us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:40.154449 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:40.154458 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:05:40.154510 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:40.154510 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:40.154522 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:40.154596 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:40.156101 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:40.156855 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:40.158555 (+ 1700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:40.158877 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:40.158938 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:40.163581 (+ 4643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:40.163583 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:40.163584 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:40.163591 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:40.165868 (+ 2277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:40.166929 (+ 1061us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:40.166930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:40.166931 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:40.166998 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:40.167233 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:40.167234 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:40.167234 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:40.167387 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:40.167559 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:40.168027 (+ 468us) server_negotiation.cc:299] Negotiation successful
0808 05:05:40.168122 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":75,"threads_started":1}
Aug 08 05:05:40 dist-test-slave-7kzw krb5kdc[28760](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165540, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:40.762542 30509 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:40.762732 30509 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
I20260808 05:05:40.763142 30196 ts_manager.cc:194] Registered new tserver with Master: 6767a3a09df94ba7bef696c1aca5f8b2 (127.11.70.193:40821)
I20260808 05:05:40.763914 30196 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:41265
I20260808 05:05:40.967478 30708 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:40.967650 30708 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
I20260808 05:05:40.968073 30196 ts_manager.cc:194] Registered new tserver with Master: b90fb6e29be24a3a9d6e274f35663ac6 (127.11.70.194:42359)
I20260808 05:05:40.968634 30196 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:35583
Aug 08 05:05:41 dist-test-slave-7kzw krb5kdc[28760](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165540, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for HTTP/127.11.70.212@KRBTEST.COM
I20260808 05:05:41.162813 30900 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:41.162969 30900 heartbeater.cc:511] Master 127.11.70.254:46631 requested a full tablet report, sending...
I20260808 05:05:41.163349 30196 ts_manager.cc:194] Registered new tserver with Master: d583254623fa42549bcd437514ba81b6 (127.11.70.195:42523)
I20260808 05:05:41.163869 30196 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:33571
I20260808 05:05:41.170276 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:05:41.179558 30924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.171388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37680 (local address 127.11.70.254:46631)
0808 05:05:41.171657 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:41.171659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:41.171763 (+ 104us) server_negotiation.cc:407] Connection header received
0808 05:05:41.171858 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:41.171858 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:41.171870 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:41.171912 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:41.172672 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.173466 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.174541 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.174856 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.174896 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.176476 (+ 1580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:41.176478 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:41.176478 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:41.176486 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:41.178277 (+ 1791us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:41.178698 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:41.178699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:41.178699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:41.178761 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:41.178953 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:41.178953 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:41.178954 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:41.179087 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:41.179164 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:41.179367 (+ 203us) server_negotiation.cc:299] Negotiation successful
0808 05:05:41.179451 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":72,"threads_started":1}
I20260808 05:05:41.182263 30196 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37680:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:05:41.184445 30196 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:05:41.206076 30930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.193301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:40821 (local address 127.0.0.1:43486)
0808 05:05:41.198805 (+ 5504us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:41.198813 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:41.198845 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:41.199474 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:41.199475 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:41.199476 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:41.199501 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.199502 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.201305 (+ 1803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.201306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.202605 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.202608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.205746 (+ 3138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.205748 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.205832 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.205848 (+ 16us) client_negotiation.cc:769] Sending connection context
0808 05:05:41.205923 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:05:41.205979 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5486,"thread_start_us":60,"threads_started":1}
I20260808 05:05:41.206378 30933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.192957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:42359 (local address 127.0.0.1:46162)
0808 05:05:41.198565 (+ 5608us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:41.198618 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:41.198696 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:41.199318 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:41.199321 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:41.199324 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:41.199398 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.199400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.200918 (+ 1518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.200919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.205067 (+ 4148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.205069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.206093 (+ 1024us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.206095 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.206202 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.206206 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:05:41.206254 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:05:41.206293 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5566,"mutex_wait_us":2361,"thread_start_us":70,"threads_started":1}
I20260808 05:05:41.207460 30935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.193692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46162 (local address 127.11.70.194:42359)
0808 05:05:41.198992 (+ 5300us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:41.198998 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:41.199009 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:05:41.199046 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:41.199048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:41.199067 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:41.199146 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:41.199674 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.200822 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.205153 (+ 4331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.205932 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.206003 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.206056 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:41.207326 (+ 1270us) server_negotiation.cc:299] Negotiation successful
0808 05:05:41.207377 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5262,"thread_start_us":68,"threads_started":1}
I20260808 05:05:41.208379 30606 tablet_service.cc:1467] Processing CreateTablet for tablet 8f28b17e87f743f8809969c06545463c (DEFAULT_TABLE table=test-table [id=839ca113743e4ec49378839c5fa0bd4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:05:41.208832 30606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f28b17e87f743f8809969c06545463c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:41.208928 30934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.193156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:42523 (local address 127.0.0.1:49916)
0808 05:05:41.198644 (+ 5488us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:41.198656 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:41.198709 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:41.199526 (+ 817us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:41.199527 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:41.199530 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:41.199592 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.199593 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.202637 (+ 3044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.202638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.203753 (+ 1115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.203755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.208407 (+ 4652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.208408 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.208475 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.208479 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:05:41.208526 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 05:05:41.208855 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5465,"thread_start_us":54,"threads_started":1}
I20260808 05:05:41.209220 30936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.193851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49916 (local address 127.11.70.195:42523)
0808 05:05:41.199297 (+ 5446us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:41.199302 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:41.199311 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:05:41.199346 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:41.199347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:41.199363 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:41.199432 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:41.201449 (+ 2017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.202535 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.206762 (+ 4227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.208240 (+ 1478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.208318 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.208371 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:41.209087 (+ 716us) server_negotiation.cc:299] Negotiation successful
0808 05:05:41.209135 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5411,"thread_start_us":52,"threads_started":1}
I20260808 05:05:41.209823 30808 tablet_service.cc:1467] Processing CreateTablet for tablet 8f28b17e87f743f8809969c06545463c (DEFAULT_TABLE table=test-table [id=839ca113743e4ec49378839c5fa0bd4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:05:41.210139 30808 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f28b17e87f743f8809969c06545463c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:41.211719 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.193994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43486 (local address 127.11.70.193:40821)
0808 05:05:41.199052 (+ 5058us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:41.199057 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:41.199068 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:05:41.199114 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:41.199116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:41.199133 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:41.199215 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:41.200103 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.201202 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.204714 (+ 3512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.205562 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.205637 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.205707 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:41.211585 (+ 5878us) server_negotiation.cc:299] Negotiation successful
0808 05:05:41.211642 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5019,"thread_start_us":57,"threads_started":1}
I20260808 05:05:41.212316 30397 tablet_service.cc:1467] Processing CreateTablet for tablet 8f28b17e87f743f8809969c06545463c (DEFAULT_TABLE table=test-table [id=839ca113743e4ec49378839c5fa0bd4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:05:41.212637 30397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f28b17e87f743f8809969c06545463c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:41.217903 30939 tablet_bootstrap.cc:492] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: Bootstrap starting.
I20260808 05:05:41.218632 30939 tablet_bootstrap.cc:654] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:41.218951 30939 log.cc:824] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:41.219312 30940 tablet_bootstrap.cc:492] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6: Bootstrap starting.
I20260808 05:05:41.219841 30939 tablet_bootstrap.cc:492] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: No bootstrap required, opened a new log
I20260808 05:05:41.219980 30939 ts_tablet_manager.cc:1397] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:05:41.220254 30940 tablet_bootstrap.cc:654] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:41.220643 30940 log.cc:824] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:41.220973 30941 tablet_bootstrap.cc:492] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2: Bootstrap starting.
I20260808 05:05:41.221698 30941 tablet_bootstrap.cc:654] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:41.222036 30941 log.cc:824] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:41.222728 30939 raft_consensus.cc:348] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } }
I20260808 05:05:41.222905 30940 tablet_bootstrap.cc:492] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6: No bootstrap required, opened a new log
I20260808 05:05:41.222972 30940 ts_tablet_manager.cc:1397] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260808 05:05:41.223050 30939 raft_consensus.cc:374] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:41.223153 30939 raft_consensus.cc:729] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d583254623fa42549bcd437514ba81b6, State: Initialized, Role: FOLLOWER
I20260808 05:05:41.223342 30939 consensus_queue.cc:260] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } }
I20260808 05:05:41.223692 30939 ts_tablet_manager.cc:1428] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s
I20260808 05:05:41.223865 30900 heartbeater.cc:503] Master 127.11.70.254:46631 was elected leader, sending a full tablet report...
I20260808 05:05:41.225456 30940 raft_consensus.cc:348] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } }
I20260808 05:05:41.225626 30940 raft_consensus.cc:374] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:41.225659 30940 raft_consensus.cc:729] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b90fb6e29be24a3a9d6e274f35663ac6, State: Initialized, Role: FOLLOWER
I20260808 05:05:41.225791 30940 consensus_queue.cc:260] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } }
I20260808 05:05:41.226037 30940 ts_tablet_manager.cc:1428] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:05:41.226104 30708 heartbeater.cc:503] Master 127.11.70.254:46631 was elected leader, sending a full tablet report...
I20260808 05:05:41.226696 30941 tablet_bootstrap.cc:492] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2: No bootstrap required, opened a new log
I20260808 05:05:41.226768 30941 ts_tablet_manager.cc:1397] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 05:05:41.229326 30941 raft_consensus.cc:348] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } }
I20260808 05:05:41.229488 30941 raft_consensus.cc:374] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:41.229519 30941 raft_consensus.cc:729] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6767a3a09df94ba7bef696c1aca5f8b2, State: Initialized, Role: FOLLOWER
I20260808 05:05:41.229643 30941 consensus_queue.cc:260] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } }
I20260808 05:05:41.229898 30941 ts_tablet_manager.cc:1428] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:05:41.229949 30509 heartbeater.cc:503] Master 127.11.70.254:46631 was elected leader, sending a full tablet report...
I20260808 05:05:41.230659 30946 raft_consensus.cc:482] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:05:41.230803 30946 raft_consensus.cc:504] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } }
I20260808 05:05:41.231709 30946 leader_election.cc:288] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b90fb6e29be24a3a9d6e274f35663ac6 (127.11.70.194:42359), 6767a3a09df94ba7bef696c1aca5f8b2 (127.11.70.193:40821)
I20260808 05:05:41.238111 30938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.231644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:46591 (local address 127.11.70.193:40821)
0808 05:05:41.231687 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:41.231689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:41.234629 (+ 2940us) server_negotiation.cc:407] Connection header received
0808 05:05:41.234732 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:41.234733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:41.234742 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:41.234771 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:41.234980 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.235722 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.237144 (+ 1422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.237718 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.237766 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.237775 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:41.238000 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 05:05:41.238037 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:05:41.238405 30952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.231391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:40821 (local address 127.11.70.195:46591)
0808 05:05:41.234555 (+ 3164us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:41.234568 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:41.234660 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:41.234835 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:41.234836 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:41.234838 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:41.234914 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.234915 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.235819 (+ 904us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.235820 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.237040 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.237043 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.237846 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.237847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.237922 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.237925 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:05:41.238262 (+ 337us) client_negotiation.cc:240] Negotiation successful
0808 05:05:41.238309 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3136,"thread_start_us":107,"threads_started":1}
I20260808 05:05:41.238827 30935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.231596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:40673 (local address 127.11.70.194:42359)
0808 05:05:41.231643 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:41.231646 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:41.234657 (+ 3011us) server_negotiation.cc:407] Connection header received
0808 05:05:41.234754 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:41.234755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:41.234765 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:41.234792 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:41.235003 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.235700 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.237138 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.237722 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.237774 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.237783 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:41.238709 (+ 926us) server_negotiation.cc:299] Negotiation successful
0808 05:05:41.238757 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:05:41.238858 30425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f28b17e87f743f8809969c06545463c" candidate_uuid: "d583254623fa42549bcd437514ba81b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" is_pre_election: true
I20260808 05:05:41.239010 30425 raft_consensus.cc:2454] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d583254623fa42549bcd437514ba81b6 in term 0.
I20260808 05:05:41.239077 30951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.231396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:42359 (local address 127.11.70.195:40673)
0808 05:05:41.234585 (+ 3189us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:41.234597 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:41.234686 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:41.234851 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:41.234852 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:41.234854 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:41.234937 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.234938 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.235796 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.235797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.237020 (+ 1223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:41.237023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.238319 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.238320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:41.238399 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.238403 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:05:41.238950 (+ 547us) client_negotiation.cc:240] Negotiation successful
0808 05:05:41.238993 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3168,"mutex_wait_us":42,"thread_start_us":94,"threads_started":1}
I20260808 05:05:41.239255 30738 leader_election.cc:302] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6767a3a09df94ba7bef696c1aca5f8b2, d583254623fa42549bcd437514ba81b6; no voters:
I20260808 05:05:41.239387 30946 raft_consensus.cc:2781] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:05:41.239461 30946 raft_consensus.cc:482] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:05:41.239502 30946 raft_consensus.cc:3037] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:41.239410 30633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f28b17e87f743f8809969c06545463c" candidate_uuid: "d583254623fa42549bcd437514ba81b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" is_pre_election: true
I20260808 05:05:41.239595 30633 raft_consensus.cc:2454] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d583254623fa42549bcd437514ba81b6 in term 0.
W20260808 05:05:41.240366 30510 tablet.cc:2369] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:05:41.240340 30946 raft_consensus.cc:504] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } }
I20260808 05:05:41.240646 30425 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f28b17e87f743f8809969c06545463c" candidate_uuid: "d583254623fa42549bcd437514ba81b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6767a3a09df94ba7bef696c1aca5f8b2"
I20260808 05:05:41.240657 30633 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f28b17e87f743f8809969c06545463c" candidate_uuid: "d583254623fa42549bcd437514ba81b6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b90fb6e29be24a3a9d6e274f35663ac6"
I20260808 05:05:41.240725 30425 raft_consensus.cc:3037] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:41.240726 30633 raft_consensus.cc:3037] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:41.241583 30633 raft_consensus.cc:2454] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d583254623fa42549bcd437514ba81b6 in term 1.
I20260808 05:05:41.241583 30425 raft_consensus.cc:2454] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d583254623fa42549bcd437514ba81b6 in term 1.
I20260808 05:05:41.240602 30946 leader_election.cc:288] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [CANDIDATE]: Term 1 election: Requested vote from peers b90fb6e29be24a3a9d6e274f35663ac6 (127.11.70.194:42359), 6767a3a09df94ba7bef696c1aca5f8b2 (127.11.70.193:40821)
I20260808 05:05:41.241762 30734 leader_election.cc:302] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b90fb6e29be24a3a9d6e274f35663ac6, d583254623fa42549bcd437514ba81b6; no voters:
I20260808 05:05:41.246557 30946 raft_consensus.cc:2781] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:05:41.246757 30946 raft_consensus.cc:686] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 1 LEADER]: Becoming Leader. State: Replica: d583254623fa42549bcd437514ba81b6, State: Running, Role: LEADER
I20260808 05:05:41.247030 30946 consensus_queue.cc:237] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } }
I20260808 05:05:41.247952 30194 catalog_manager.cc:5495] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d583254623fa42549bcd437514ba81b6 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "d583254623fa42549bcd437514ba81b6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d583254623fa42549bcd437514ba81b6" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42523 } health_report { overall_health: HEALTHY } } }
I20260808 05:05:41.255736 30936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.252555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49928 (local address 127.11.70.195:42523)
0808 05:05:41.252600 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:41.252602 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:41.252612 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:05:41.252693 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:41.252694 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:41.252713 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:41.252782 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:05:41.252957 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.253684 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.254844 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:41.255123 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:41.255205 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:41.255377 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:05:41.255497 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:05:41.255584 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:41.255642 (+ 58us) server_negotiation.cc:299] Negotiation successful
0808 05:05:41.255662 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:05:41.257730 30425 raft_consensus.cc:1261] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [term 1 FOLLOWER]: Refusing update from remote peer d583254623fa42549bcd437514ba81b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:05:41.258065 30633 raft_consensus.cc:1261] T 8f28b17e87f743f8809969c06545463c P b90fb6e29be24a3a9d6e274f35663ac6 [term 1 FOLLOWER]: Refusing update from remote peer d583254623fa42549bcd437514ba81b6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:05:41.258074 30954 consensus_queue.cc:1035] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6767a3a09df94ba7bef696c1aca5f8b2" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:05:41.258366 30954 consensus_queue.cc:1035] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b90fb6e29be24a3a9d6e274f35663ac6" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:05:41.262259 30957 mvcc.cc:205] Tried to move back new op lower bound from 7316134056989069312 to 7316134056948731904. Current Snapshot: MvccSnapshot[applied={T|T < 7316134056989069312}]
I20260808 05:05:41.262673 30960 mvcc.cc:205] Tried to move back new op lower bound from 7316134056989069312 to 7316134056948731904. Current Snapshot: MvccSnapshot[applied={T|T < 7316134056989069312}]
I20260808 05:05:41.263394 30958 mvcc.cc:205] Tried to move back new op lower bound from 7316134056989069312 to 7316134056948731904. Current Snapshot: MvccSnapshot[applied={T|T < 7316134056989069312}]
I20260808 05:05:41.266409 30194 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:05:41.266539 30194 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37680:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:05:41.267302 30194 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4be1e7d1e56f46ff8a892936e6d1a919: Sending DeleteTablet for 3 replicas of tablet 8f28b17e87f743f8809969c06545463c
I20260808 05:05:41.267678 30606 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f28b17e87f743f8809969c06545463c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:05:41 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:46162
I20260808 05:05:41.267892 30808 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f28b17e87f743f8809969c06545463c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:05:41 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:49916
I20260808 05:05:41.268194 30397 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f28b17e87f743f8809969c06545463c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:05:41 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:43486
I20260808 05:05:41.268493 30973 tablet_replica.cc:330] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2: stopping tablet replica
I20260808 05:05:41.268632 30973 raft_consensus.cc:2229] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:05:41.268728 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 30255
I20260808 05:05:41.268757 30973 raft_consensus.cc:2258] T 8f28b17e87f743f8809969c06545463c P 6767a3a09df94ba7bef696c1aca5f8b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:05:41.275085 30972 tablet_replica.cc:330] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: stopping tablet replica
I20260808 05:05:41.275265 30972 raft_consensus.cc:2229] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:05:41.275435 30972 raft_consensus.cc:2258] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:05:41.275965 30972 ts_tablet_manager.cc:1905] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:05:41.278592 30972 ts_tablet_manager.cc:1918] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:05:41.278725 30972 log.cc:1196] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/8f28b17e87f743f8809969c06545463c
I20260808 05:05:41.279078 30972 ts_tablet_manager.cc:1939] T 8f28b17e87f743f8809969c06545463c P d583254623fa42549bcd437514ba81b6: Deleting consensus metadata
I20260808 05:05:41.282920 30177 catalog_manager.cc:4841] TS d583254623fa42549bcd437514ba81b6 (127.11.70.195:42523): tablet 8f28b17e87f743f8809969c06545463c (table test-table [id=839ca113743e4ec49378839c5fa0bd4d]) successfully deleted
W20260808 05:05:41.283490 30180 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:40821 (error 108)
I20260808 05:05:41.284260 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 30513
I20260808 05:05:41.294890 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 30711
I20260808 05:05:41.303642 30933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.303140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:40821 (local address 127.0.0.1:43496)
0808 05:05:41.303529 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:41.303594 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:40821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352}
I20260808 05:05:41.303786 30933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:41.303282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:42359 (local address 127.0.0.1:46176)
0808 05:05:41.303749 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:41.303772 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.194:42359: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":456}
W20260808 05:05:41.303916 30177 catalog_manager.cc:4584] TS b90fb6e29be24a3a9d6e274f35663ac6 (127.11.70.194:42359): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f28b17e87f743f8809969c06545463c: Network error: Client connection negotiation failed: client connection to 127.11.70.194:42359: connect: Connection refused (error 111)
I20260808 05:05:41.306840 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 30150
I20260808 05:05:41.322489 11547 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 05:05:41.677796 11547 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 05:05:41.677924 11547 mini_ranger.cc:66] Stopping Ranger...
I20260808 05:05:42.032953 11547 mini_ranger.cc:68] Stopped Ranger
2026-08-08 05:05:42.033 UTC [28805] LOG: received smart shutdown request
2026-08-08 05:05:42.037 UTC [28805] LOG: background worker "logical replication launcher" (PID 28819) exited with exit code 1
2026-08-08 05:05:42.038 UTC [28809] LOG: shutting down
2026-08-08 05:05:42.227 UTC [28805] LOG: database system is shut down
2026-08-08T05:05:42Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49871 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:05:42 dist-test-slave-7kzw krb5kdc[30987](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:05:42 dist-test-slave-7kzw krb5kdc[30987](info): set up 2 sockets
Aug 08 05:05:42 dist-test-slave-7kzw krb5kdc[30987](info): commencing operation
krb5kdc: starting...
W20260808 05:05:43.626129 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:05:43 dist-test-slave-7kzw krb5kdc[30987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:05:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:05:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:05:43.757650 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:44329
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:38501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:44329,127.11.70.253:34981,127.11.70.252:35503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:43.842362 31007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:43.842674 31007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:43.842721 31007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:43.843868 31007 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:05:43.843940 31007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:43.843964 31007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:43.843998 31007 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:05:43.844025 31007 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:05:43.845580 31007 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:38501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:44329,127.11.70.253:34981,127.11.70.252:35503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:44329
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:43.845862 31007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:43.846102 31007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:43.851282 31020 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:43.851332 31015 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:43.851296 31014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:43.851598 31007 server_base.cc:1034] running on GCE node
I20260808 05:05:43.851892 31007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:43.852205 31007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:43.853391 31007 hybrid_clock.cc:648] HybridClock initialized: now 1786165543853385 us; error 38 us; skew 500 ppm
Aug 08 05:05:43 dist-test-slave-7kzw krb5kdc[30987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165543, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:43.861879 31007 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:05:43.862286 31007 webserver.cc:460] Webserver started at http://127.11.70.254:35239/ using document root <none> and password file <none>
I20260808 05:05:43.862566 31007 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:43.862617 31007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:43.862709 31007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:05:43.863732 31007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "df265c12f73c47f69f69dde1e630abde"
format_stamp: "Formatted at 2026-08-08 05:05:43 on dist-test-slave-7kzw"
server_key: "0696537264ddd8f44caa3d81380d27b9"
server_key_iv: "156e8ad2bb0060c2818cdf367308ed8f"
server_key_version: "encryptionkey@0"
I20260808 05:05:43.864033 31007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "df265c12f73c47f69f69dde1e630abde"
format_stamp: "Formatted at 2026-08-08 05:05:43 on dist-test-slave-7kzw"
server_key: "0696537264ddd8f44caa3d81380d27b9"
server_key_iv: "156e8ad2bb0060c2818cdf367308ed8f"
server_key_version: "encryptionkey@0"
I20260808 05:05:43.865317 31007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:05:43.866066 31030 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:43.866240 31007 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:43.866353 31007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "df265c12f73c47f69f69dde1e630abde"
format_stamp: "Formatted at 2026-08-08 05:05:43 on dist-test-slave-7kzw"
server_key: "0696537264ddd8f44caa3d81380d27b9"
server_key_iv: "156e8ad2bb0060c2818cdf367308ed8f"
server_key_version: "encryptionkey@0"
I20260808 05:05:43.866429 31007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:43.888653 31007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:43.891124 31007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:43.891300 31007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:43.895437 31007 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:44329
I20260808 05:05:43.895480 31120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:44329 every 8 connection(s)
I20260808 05:05:43.895881 31007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:05:43.896824 31121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:43.898435 31121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:05:43.903623 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 31007
I20260808 05:05:43.903754 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:05:43.903982 11547 external_mini_cluster.cc:1428] Setting key 2cbc79584ef7f2de668017ab12270d93
Aug 08 05:05:43 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165543, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:43.908742 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:43.899264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35444 (local address 127.11.70.254:44329)
0808 05:05:43.899479 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:43.899488 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:43.899623 (+ 135us) server_negotiation.cc:407] Connection header received
0808 05:05:43.900200 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:43.900202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:43.900222 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:43.900337 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:43.900909 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:43.901729 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:43.902628 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:43.902965 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:43.903100 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:43.905435 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:43.905443 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:43.905444 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:43.905451 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:43.907081 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:43.907609 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:43.907613 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:43.907613 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:43.907700 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:43.907965 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:43.907966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:43.907966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:43.908172 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:43.908237 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:43.908478 (+ 241us) server_negotiation.cc:299] Negotiation successful
0808 05:05:43.908579 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":95,"threads_started":1}
I20260808 05:05:43.908886 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:43.899248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:44329 (local address 127.0.0.1:35444)
0808 05:05:43.899469 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:43.899513 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:43.900033 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:43.900345 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:43.900347 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:43.900630 (+ 283us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:43.900803 (+ 173us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:43.900807 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:43.901834 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:43.901835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:43.902536 (+ 701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:43.902539 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:43.903071 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:43.903072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:43.903139 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:43.903659 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:43.903669 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:43.905342 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:43.907207 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:43.907214 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:43.907217 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:43.907520 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:43.907778 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:43.907779 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:43.907779 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:43.907897 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:43.908245 (+ 348us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:43.908253 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:43.908333 (+ 80us) client_negotiation.cc:769] Sending connection context
0808 05:05:43.908437 (+ 104us) client_negotiation.cc:240] Negotiation successful
0808 05:05:43.908679 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":59,"spinlock_wait_cycles":8448,"thread_start_us":124,"threads_started":1}
I20260808 05:05:43.909803 31121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:05:43.910243 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:43.910062 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:34981 (local address 127.0.0.1:59230)
0808 05:05:43.910150 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:43.910216 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260808 05:05:43.910373 31031 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
I20260808 05:05:43.910861 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:43.910751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:34981 (local address 127.0.0.1:59242)
0808 05:05:43.910780 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:43.910831 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260808 05:05:43.911024 31121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.253:34981: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.11.70.253@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab.
Entry for principal kudu/127.11.70.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab.
I20260808 05:05:43.931548 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.253:34981
--webserver_interface=127.11.70.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab
--principal=kudu/127.11.70.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:38501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:44329,127.11.70.253:34981,127.11.70.252:35503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:05:43.960340 31121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } attempt: 1
I20260808 05:05:43.960876 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:43.960716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:34981 (local address 127.0.0.1:59252)
0808 05:05:43.960802 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:43.960841 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260808 05:05:43.961252 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:43.961145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:34981 (local address 127.0.0.1:59254)
0808 05:05:43.961194 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:43.961226 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 05:05:43.961346 31121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.253:34981: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
W20260808 05:05:44.015910 31130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:44.016197 31130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:44.016240 31130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:44.017373 31130 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:05:44.017443 31130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:44.017465 31130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:44.017484 31130 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:05:44.017513 31130 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:05:44.019073 31130 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:38501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:44329,127.11.70.253:34981,127.11.70.252:35503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab
--principal=kudu/127.11.70.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.253:34981
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.70.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:44.019368 31130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:44.019601 31130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:44.025470 31144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:44.025498 31141 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:44.025699 31130 server_base.cc:1034] running on GCE node
W20260808 05:05:44.025516 31138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:44.026079 31130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:44.026427 31130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:44.027670 31130 hybrid_clock.cc:648] HybridClock initialized: now 1786165544027615 us; error 55 us; skew 500 ppm
I20260808 05:05:44.029513 31121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } attempt: 2
I20260808 05:05:44.030007 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.029846 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:34981 (local address 127.0.0.1:59268)
0808 05:05:44.029922 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.029965 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:44.030426 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.030306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:34981 (local address 127.0.0.1:59280)
0808 05:05:44.030358 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.030391 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 05:05:44.030546 31121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.253:34981: Network error: Client connection negotiation failed: client connection to 127.11.70.253:34981: connect: Connection refused (error 111)
I20260808 05:05:44.030769 31130 init.cc:377] Logged in from keytab as kudu/127.11.70.253@KRBTEST.COM (short username kudu)
I20260808 05:05:44.031183 31130 webserver.cc:460] Webserver started at http://127.11.70.253:35485/ using document root <none> and password file <none>
I20260808 05:05:44.031389 31130 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:44.031442 31130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:44.031549 31130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:05:44.032706 31130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/data/instance:
uuid: "e92b3f0091ba47f6ad018d51785b787d"
format_stamp: "Formatted at 2026-08-08 05:05:44 on dist-test-slave-7kzw"
server_key: "7f8512d43ce1020844b287199c03c347"
server_key_iv: "bd97f1708af44e775f82757bfa7f3a34"
server_key_version: "encryptionkey@0"
I20260808 05:05:44.033038 31130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/wal/instance:
uuid: "e92b3f0091ba47f6ad018d51785b787d"
format_stamp: "Formatted at 2026-08-08 05:05:44 on dist-test-slave-7kzw"
server_key: "7f8512d43ce1020844b287199c03c347"
server_key_iv: "bd97f1708af44e775f82757bfa7f3a34"
server_key_version: "encryptionkey@0"
I20260808 05:05:44.034408 31130 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:05:44.035293 31153 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:44.035467 31130 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:05:44.035557 31130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/wal
uuid: "e92b3f0091ba47f6ad018d51785b787d"
format_stamp: "Formatted at 2026-08-08 05:05:44 on dist-test-slave-7kzw"
server_key: "7f8512d43ce1020844b287199c03c347"
server_key_iv: "bd97f1708af44e775f82757bfa7f3a34"
server_key_version: "encryptionkey@0"
I20260808 05:05:44.035611 31130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:44.065908 31130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:44.068459 31130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:44.068585 31130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:44.072809 31130 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.253:34981
I20260808 05:05:44.072929 31232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.253:34981 every 8 connection(s)
I20260808 05:05:44.073271 31130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
I20260808 05:05:44.074236 31233 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:44.075860 31233 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:05:44.077659 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 31130
I20260808 05:05:44.077828 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-1/wal/instance
I20260808 05:05:44.078034 11547 external_mini_cluster.cc:1428] Setting key 55af38fe16cb28226e98ad33b629e96d
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:44.086448 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.076636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35460 (local address 127.11.70.254:44329)
0808 05:05:44.076713 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.076715 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.076945 (+ 230us) server_negotiation.cc:407] Connection header received
0808 05:05:44.077391 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.077392 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.077405 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.077460 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.078260 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.079034 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.080017 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.080243 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.080494 (+ 251us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.083143 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.083144 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.083145 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.083152 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.084732 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.085289 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.085290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.085290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.085355 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.085707 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.085708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.085708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.085846 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.085918 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.086291 (+ 373us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.086373 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:05:44.086755 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.076620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:44329 (local address 127.0.0.1:35460)
0808 05:05:44.076821 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.076860 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:44.077308 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:44.077558 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:44.077561 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:44.077887 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:44.078149 (+ 262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.078155 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.079131 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.079131 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.079916 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.079918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.080507 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.080509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.080664 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.081200 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:44.081209 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:44.083030 (+ 1821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:44.084822 (+ 1792us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.084831 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.084833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.085183 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.085435 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.085436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.085436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.085595 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.085933 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:44.085942 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:44.086130 (+ 188us) client_negotiation.cc:769] Sending connection context
0808 05:05:44.086261 (+ 131us) client_negotiation.cc:240] Negotiation successful
0808 05:05:44.086444 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":105,"threads_started":1}
WARNING: no policy specified for kudu/127.11.70.252@KRBTEST.COM; defaulting to no policy
I20260808 05:05:44.087498 31233 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.252@KRBTEST.COM" created.
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:05:44.095561 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.087880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:34981 (local address 127.0.0.1:59296)
0808 05:05:44.087938 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.087951 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:44.087997 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:44.088247 (+ 250us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:44.088247 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:44.088371 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:44.088460 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.088462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.089491 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.089492 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.090055 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.090057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.090774 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.090775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.090877 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.091264 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:44.091270 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:44.092654 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:44.094408 (+ 1754us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.094409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.094410 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.094612 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.094860 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.094861 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.094862 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.094918 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.095215 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:44.095216 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:44.095256 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 05:05:44.095323 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:05:44.095427 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 05:05:44.095642 31241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.087951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59296 (local address 127.11.70.253:34981)
0808 05:05:44.088119 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.088124 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.088149 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:05:44.088169 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.088171 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.088181 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.088245 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.088652 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.089353 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.090147 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.090690 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.090769 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.092744 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.092752 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.092753 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.092760 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.094303 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.094706 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.094709 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.094710 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.094769 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.094988 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.094989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.094989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.095135 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.095224 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.095358 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.095479 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":58,"server-negotiator.queue_time_us":137,"thread_start_us":114,"threads_started":1}
I20260808 05:05:44.096496 31233 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:05:44.096951 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.096803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42240)
0808 05:05:44.096861 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.096917 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 05:05:44.097155 31159 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
I20260808 05:05:44.097707 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.097578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42242)
0808 05:05:44.097638 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.097674 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 05:05:44.097894 31233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:35503: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab.
Entry for principal kudu/127.11.70.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab.
I20260808 05:05:44.109818 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.252:35503
--webserver_interface=127.11.70.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab
--principal=kudu/127.11.70.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:38501
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:44329,127.11.70.253:34981,127.11.70.252:35503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:05:44.121865 31121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } attempt: 3
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165543, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:05:44.129837 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.122240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:34981 (local address 127.0.0.1:59304)
0808 05:05:44.122308 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.122322 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:44.122391 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:44.122596 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:44.122597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:44.122780 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:44.122848 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.122849 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.123602 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.123603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.124197 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.124199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.124602 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.124603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.124685 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.125255 (+ 570us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:44.125261 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:44.126844 (+ 1583us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:44.128747 (+ 1903us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.128748 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.128749 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.128942 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.129179 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.129180 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.129180 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.129249 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.129529 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:44.129530 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:44.129578 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 05:05:44.129673 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 05:05:44.129761 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 05:05:44.129910 31241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.122348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59304 (local address 127.11.70.253:34981)
0808 05:05:44.122424 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.122426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.122438 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:05:44.122496 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.122497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.122510 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.122589 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.122934 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.123464 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.124286 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.124508 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.124590 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.126938 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.126940 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.126940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.126949 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.128635 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.129021 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.129022 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.129022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.129086 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.129319 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.129320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.129320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.129462 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.129529 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.129715 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.129803 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 05:05:44.130349 31121 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:05:44.130769 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.130650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42244)
0808 05:05:44.130702 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.130739 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:05:44.131106 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.131006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42256)
0808 05:05:44.131054 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.131084 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 05:05:44.131234 31121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:35503: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
I20260808 05:05:44.147148 31233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } attempt: 1
I20260808 05:05:44.147737 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.147558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42264)
0808 05:05:44.147632 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.147696 (+ 64us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 05:05:44.148193 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.148096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42268)
0808 05:05:44.148142 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.148173 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 05:05:44.148334 31233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:35503: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
I20260808 05:05:44.162374 31121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } attempt: 1
I20260808 05:05:44.162881 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.162741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42280)
0808 05:05:44.162801 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.162846 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 05:05:44.163373 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.163283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42294)
0808 05:05:44.163326 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.163353 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 05:05:44.163486 31121 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:35503: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
W20260808 05:05:44.198017 31247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:44.198230 31247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:44.198254 31247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:44.199319 31247 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:05:44.199357 31247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:44.199370 31247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:44.199383 31247 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:05:44.199394 31247 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:05:44.200806 31247 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:38501
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:44329,127.11.70.253:34981,127.11.70.252:35503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab
--principal=kudu/127.11.70.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.252:35503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.70.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:44.201004 31247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:44.201180 31247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:44.206274 31254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:44.206269 31256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:44.206270 31253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:44.206537 31247 server_base.cc:1034] running on GCE node
I20260808 05:05:44.206952 31247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:44.207326 31247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:44.208508 31247 hybrid_clock.cc:648] HybridClock initialized: now 1786165544208495 us; error 49 us; skew 500 ppm
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:44.211114 31247 init.cc:377] Logged in from keytab as kudu/127.11.70.252@KRBTEST.COM (short username kudu)
I20260808 05:05:44.211570 31247 webserver.cc:460] Webserver started at http://127.11.70.252:41025/ using document root <none> and password file <none>
I20260808 05:05:44.211757 31247 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:44.211798 31247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:44.211886 31247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:05:44.212874 31247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/data/instance:
uuid: "cc5ae28342d348f89eb9b2a9694fe383"
format_stamp: "Formatted at 2026-08-08 05:05:44 on dist-test-slave-7kzw"
server_key: "5369a8e9edb48eccc026bb0e8fda2b51"
server_key_iv: "cd4aa430b5dee618091bc5ecbe7cad10"
server_key_version: "encryptionkey@0"
I20260808 05:05:44.213193 31247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/wal/instance:
uuid: "cc5ae28342d348f89eb9b2a9694fe383"
format_stamp: "Formatted at 2026-08-08 05:05:44 on dist-test-slave-7kzw"
server_key: "5369a8e9edb48eccc026bb0e8fda2b51"
server_key_iv: "cd4aa430b5dee618091bc5ecbe7cad10"
server_key_version: "encryptionkey@0"
I20260808 05:05:44.214529 31247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 05:05:44.215294 31266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:44.215459 31247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:44.215556 31247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/wal
uuid: "cc5ae28342d348f89eb9b2a9694fe383"
format_stamp: "Formatted at 2026-08-08 05:05:44 on dist-test-slave-7kzw"
server_key: "5369a8e9edb48eccc026bb0e8fda2b51"
server_key_iv: "cd4aa430b5dee618091bc5ecbe7cad10"
server_key_version: "encryptionkey@0"
I20260808 05:05:44.215654 31247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:44.216504 31233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } attempt: 2
I20260808 05:05:44.216900 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.216770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42304)
0808 05:05:44.216829 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.216859 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 05:05:44.217310 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.217221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42306)
0808 05:05:44.217269 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.217293 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 05:05:44.217424 31233 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:35503: Network error: Client connection negotiation failed: client connection to 127.11.70.252:35503: connect: Connection refused (error 111)
I20260808 05:05:44.223466 31247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:44.225389 31247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:44.225535 31247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:44.229507 31247 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.252:35503
I20260808 05:05:44.229585 31345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.252:35503 every 8 connection(s)
I20260808 05:05:44.229929 31247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
I20260808 05:05:44.230914 31346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:44.232427 31346 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:05:44.235838 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 31247
I20260808 05:05:44.235970 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165386228479-11547-0/minicluster-data/master-2/wal/instance
I20260808 05:05:44.236162 11547 external_mini_cluster.cc:1428] Setting key 794382c3c79ea4e6ea0c9124a5f0017b
I20260808 05:05:44.238600 31121 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } attempt: 2
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:05:44.242980 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.233098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35468 (local address 127.11.70.254:44329)
0808 05:05:44.233197 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.233200 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.233381 (+ 181us) server_negotiation.cc:407] Connection header received
0808 05:05:44.233931 (+ 550us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.233932 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.233945 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.233996 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.234675 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.235160 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.236270 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.236499 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.236566 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.239343 (+ 2777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.239344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.239345 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.239352 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.241340 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.241848 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.241849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.241850 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.241914 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.242204 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.242206 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.242206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.242359 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.242451 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.242781 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.242875 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:05:44.243085 31348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.233059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:44329 (local address 127.0.0.1:35468)
0808 05:05:44.233252 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.233296 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:44.233810 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:44.234061 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:44.234065 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:44.234322 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:44.234576 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.234581 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.235271 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.235272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.236183 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.236185 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.236568 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.236569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.236716 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.237345 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:44.237353 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:44.239222 (+ 1869us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:44.241436 (+ 2214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.241445 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.241447 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.241783 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.241967 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.241967 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.241968 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.242114 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.242455 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:44.242480 (+ 25us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:44.242633 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 05:05:44.242721 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 05:05:44.242896 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":96,"threads_started":1}
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165543, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:05:44.243896 31346 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:05:44.247104 31124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.239144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42312)
0808 05:05:44.239218 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.239231 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:44.239279 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:44.239468 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:44.239469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:44.239667 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:44.239741 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.239743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.240507 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.240509 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.241147 (+ 638us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.241150 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.241525 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.241527 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.241581 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.242042 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:44.242047 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:44.243738 (+ 1691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:44.245972 (+ 2234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.245973 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.245974 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.246158 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.246397 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.246398 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.246398 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.246494 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.246774 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:44.246775 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:44.246821 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 05:05:44.246906 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 05:05:44.247005 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260808 05:05:44.247123 31353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.239227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42312 (local address 127.11.70.252:35503)
0808 05:05:44.239343 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.239345 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.239352 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:05:44.239371 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.239372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.239379 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.239449 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.239839 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.240407 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.241226 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.241438 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.241742 (+ 304us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.243829 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.243838 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.243838 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.243846 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.245865 (+ 2019us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.246248 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.246251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.246252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.246321 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.246548 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.246549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.246549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.246692 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.246780 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.246940 (+ 160us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.247012 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":68,"threads_started":1}
I20260808 05:05:44.249173 31352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.236578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42310 (local address 127.11.70.252:35503)
0808 05:05:44.236813 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.236818 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.236884 (+ 66us) server_negotiation.cc:407] Connection header received
0808 05:05:44.236926 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.236928 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.236960 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.237030 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.237865 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.238719 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.239763 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.240310 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.240386 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.244251 (+ 3865us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.244253 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.244253 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.244261 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.247608 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.248066 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.248067 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.248068 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.248146 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.248404 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.248405 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.248406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.248547 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.248726 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.248816 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.248900 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":196,"thread_start_us":148,"threads_started":1}
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:05:44.249291 31121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde: Bootstrap starting.
I20260808 05:05:44.250367 31121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:44.251024 31121 log.cc:824] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:44.251960 31121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde: No bootstrap required, opened a new log
I20260808 05:05:44.252526 31348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.244128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:34981 (local address 127.0.0.1:59316)
0808 05:05:44.244169 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.244178 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:44.244232 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:44.245075 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:44.245076 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:44.245358 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:44.245390 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.245392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.246072 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.246073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.246949 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.246952 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.247571 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.247572 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.247636 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.248079 (+ 443us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:44.248084 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:44.249591 (+ 1507us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:44.251356 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.251357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.251357 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.251598 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.251827 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.251828 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.251829 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.251894 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.252181 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:44.252182 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:44.252227 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:05:44.252334 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 05:05:44.252433 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:05:44.252556 31241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.244381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59316 (local address 127.11.70.253:34981)
0808 05:05:44.244456 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.244459 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.244468 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:05:44.244494 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.244496 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.244507 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.244573 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.245486 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.245951 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.247074 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.247414 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.247468 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.249687 (+ 2219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.249688 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.249689 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.249698 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.251222 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.251671 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.251672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.251672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.251741 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.251975 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.251976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.251977 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.252106 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.252191 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.252367 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.252452 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:05:44.252852 31346 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:05:44.254302 31121 raft_consensus.cc:348] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } }
I20260808 05:05:44.254400 31121 raft_consensus.cc:374] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:44.254422 31121 raft_consensus.cc:729] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df265c12f73c47f69f69dde1e630abde, State: Initialized, Role: FOLLOWER
I20260808 05:05:44.254597 31121 consensus_queue.cc:260] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } }
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:44.254928 31357 sys_catalog.cc:455] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.255033 31357 sys_catalog.cc:458] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:05:44.254935 31121 sys_catalog.cc:564] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [sys.catalog]: configured and running, proceeding with master startup.
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
W20260808 05:05:44.257449 31369 catalog_manager.cc:1558] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:05:44.257498 31369 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:05:44.260962 31348 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.253132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42318)
0808 05:05:44.253386 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.253396 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:44.253448 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:44.253588 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:44.253589 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:44.253730 (+ 141us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:44.253756 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.253757 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.254552 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.254554 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.255305 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.255308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.255780 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.255781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.255824 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.256179 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:44.256184 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:44.257593 (+ 1409us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:44.259793 (+ 2200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.259794 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.259795 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.259972 (+ 177us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.260206 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.260207 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.260207 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.260269 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.260589 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:44.260590 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:44.260632 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 05:05:44.260739 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 05:05:44.260849 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242}
I20260808 05:05:44.261029 31352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.253332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42318 (local address 127.11.70.252:35503)
0808 05:05:44.253385 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.253386 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.253432 (+ 46us) server_negotiation.cc:407] Connection header received
0808 05:05:44.253515 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.253516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.253525 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.253586 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.253837 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.254414 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.255396 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.255667 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.255716 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.257685 (+ 1969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.257687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.257687 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.257694 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.259690 (+ 1996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.260068 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.260069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.260070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.260127 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.260358 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.260359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.260360 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.260512 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.260597 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.260787 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.260903 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":33}
I20260808 05:05:44.258957 31007 master_runner.cc:186] Error getting master registration for 127.11.70.253:34981: OK, instance_id { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" instance_seqno: 1786165544071714 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:05:44.261377 31007 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:05:44.261765 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.249817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35484 (local address 127.11.70.254:44329)
0808 05:05:44.249851 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.249852 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.249860 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:05:44.249878 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.249879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.249887 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.249949 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.250661 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.251319 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.252224 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.252484 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.252544 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.255385 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.255387 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.255387 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.255394 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.257233 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.257927 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.257928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.257928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.257983 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.258589 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.258591 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.258591 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.258726 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.258871 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.261578 (+ 2707us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.261670 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:05:44.263299 31346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383: Bootstrap starting.
I20260808 05:05:44.264096 31346 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:44.264431 31346 log.cc:824] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:44.265328 31346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383: No bootstrap required, opened a new log
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:05:44.267938 31346 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } }
I20260808 05:05:44.268112 31346 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:44.268210 31346 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5ae28342d348f89eb9b2a9694fe383, State: Initialized, Role: FOLLOWER
I20260808 05:05:44.268404 31346 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } }
I20260808 05:05:44.268740 31372 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.268801 31346 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:05:44.268875 31372 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:05:44.271478 31388 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:05:44.271601 31388 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:05:44.272001 31241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.262350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59322 (local address 127.11.70.253:34981)
0808 05:05:44.262392 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.262394 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.262405 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:05:44.262455 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.262455 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.262487 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.262562 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.263185 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.263865 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.264860 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.265178 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.265248 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.268312 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.268314 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.268314 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.268323 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.270275 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.270692 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.270693 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.270693 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.270750 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.270941 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.270941 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.270942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.271065 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.271355 (+ 290us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.271817 (+ 462us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.271901 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:05:44.273581 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:05:44.272852 31247 master_runner.cc:186] Error getting master registration for 127.11.70.253:34981: OK, instance_id { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" instance_seqno: 1786165544071714 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:05:44.275127 31247 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:05:44.284843 31123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.275641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35488 (local address 127.11.70.254:44329)
0808 05:05:44.275687 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.275689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.275938 (+ 249us) server_negotiation.cc:407] Connection header received
0808 05:05:44.276065 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.276066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.276077 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.276112 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.277108 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.277834 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.279263 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.279569 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.279647 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.281260 (+ 1613us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.281261 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.281262 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.281269 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.283556 (+ 2287us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.283959 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.283961 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.283962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.284021 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.284248 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.284249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.284249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.284378 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.284446 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.284670 (+ 224us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.284751 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:05:44.285069 31241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.275096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59334 (local address 127.11.70.253:34981)
0808 05:05:44.275143 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.275145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.275551 (+ 406us) server_negotiation.cc:407] Connection header received
0808 05:05:44.275632 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.275633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.275644 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.275703 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.276525 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.277257 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.278294 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.278608 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.278650 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.280393 (+ 1743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.280395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.280395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.280402 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.282157 (+ 1755us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.283357 (+ 1200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.283358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.283358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.283424 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.283671 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.283671 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.283672 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.283819 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.284608 (+ 789us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.284851 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.284942 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:05:44.285238 31352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.275397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42326 (local address 127.11.70.252:35503)
0808 05:05:44.275473 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.275475 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.275939 (+ 464us) server_negotiation.cc:407] Connection header received
0808 05:05:44.276064 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.276065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.276077 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.276112 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.277107 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.277839 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.278988 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.279290 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.279371 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.281777 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.281778 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.281779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.281786 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.283752 (+ 1966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.284213 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.284215 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.284215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.284291 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.284614 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.284615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.284615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.284753 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.284826 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.285049 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.285134 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:05:44.308602 31233 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } attempt: 3
Aug 08 05:05:44 dist-test-slave-7kzw krb5kdc[30987](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165544, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:05:44.315949 31239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.308940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:35503 (local address 127.0.0.1:42342)
0808 05:05:44.308995 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:44.309008 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:44.309052 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:44.309206 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:44.309207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:44.309376 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:44.309419 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.309420 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.310072 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.310073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.310671 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:44.310673 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.311024 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.311025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:44.311089 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.311908 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:44.311913 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:44.313192 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:44.314874 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.314875 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.314875 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.315057 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.315275 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:44.315276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:44.315276 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:44.315343 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:44.315612 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:44.315613 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:44.315657 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 05:05:44.315744 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:05:44.315851 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 05:05:44.315949 31352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:44.308982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42342 (local address 127.11.70.252:35503)
0808 05:05:44.309033 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:44.309035 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:44.309045 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:05:44.309107 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:44.309108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:44.309118 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:44.309187 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:44.309499 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.309972 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.310753 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:44.310939 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:44.311022 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:44.313283 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:44.313284 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:44.313285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:44.313293 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:44.314756 (+ 1463us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.315146 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.315148 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.315148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.315207 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:44.315417 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:44.315418 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:44.315418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:44.315535 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:44.315608 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:44.315771 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 05:05:44.315850 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:05:44.317689 31233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d: Bootstrap starting.
I20260808 05:05:44.318588 31233 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:44.318994 31233 log.cc:824] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:44.319880 31233 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d: No bootstrap required, opened a new log
I20260808 05:05:44.321421 31233 raft_consensus.cc:348] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } }
I20260808 05:05:44.321522 31233 raft_consensus.cc:374] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:44.321547 31233 raft_consensus.cc:729] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e92b3f0091ba47f6ad018d51785b787d, State: Initialized, Role: FOLLOWER
I20260808 05:05:44.321669 31233 consensus_queue.cc:260] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } }
I20260808 05:05:44.321928 31399 sys_catalog.cc:455] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.321995 31233 sys_catalog.cc:564] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:05:44.321998 31399 sys_catalog.cc:458] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:05:44.323923 31415 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:05:44.324038 31415 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:05:44.325750 31130 master_runner.cc:263] No leader master found from master e92b3f0091ba47f6ad018d51785b787d
I20260808 05:05:44.325798 31130 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:05:44.380988 31399 raft_consensus.cc:482] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:05:44.381115 31399 raft_consensus.cc:504] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } }
I20260808 05:05:44.381341 31399 leader_election.cc:288] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df265c12f73c47f69f69dde1e630abde (127.11.70.254:44329), cc5ae28342d348f89eb9b2a9694fe383 (127.11.70.252:35503)
I20260808 05:05:44.381793 31309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e92b3f0091ba47f6ad018d51785b787d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5ae28342d348f89eb9b2a9694fe383" is_pre_election: true
I20260808 05:05:44.381950 31309 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e92b3f0091ba47f6ad018d51785b787d in term 0.
I20260808 05:05:44.382277 31159 leader_election.cc:302] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5ae28342d348f89eb9b2a9694fe383, e92b3f0091ba47f6ad018d51785b787d; no voters:
I20260808 05:05:44.382452 31399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:05:44.382544 31399 raft_consensus.cc:482] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:05:44.382570 31399 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:44.383481 31399 raft_consensus.cc:504] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } }
I20260808 05:05:44.383596 31399 leader_election.cc:288] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [CANDIDATE]: Term 1 election: Requested vote from peers df265c12f73c47f69f69dde1e630abde (127.11.70.254:44329), cc5ae28342d348f89eb9b2a9694fe383 (127.11.70.252:35503)
I20260808 05:05:44.383996 31073 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e92b3f0091ba47f6ad018d51785b787d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df265c12f73c47f69f69dde1e630abde"
I20260808 05:05:44.384148 31073 raft_consensus.cc:3037] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:44.384143 31309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e92b3f0091ba47f6ad018d51785b787d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5ae28342d348f89eb9b2a9694fe383"
I20260808 05:05:44.384212 31309 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:44.384980 31309 raft_consensus.cc:2454] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b3f0091ba47f6ad018d51785b787d in term 1.
I20260808 05:05:44.385102 31073 raft_consensus.cc:2454] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e92b3f0091ba47f6ad018d51785b787d in term 1.
I20260808 05:05:44.385169 31159 leader_election.cc:302] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5ae28342d348f89eb9b2a9694fe383, e92b3f0091ba47f6ad018d51785b787d; no voters:
I20260808 05:05:44.383997 31074 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e92b3f0091ba47f6ad018d51785b787d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df265c12f73c47f69f69dde1e630abde" is_pre_election: true
I20260808 05:05:44.385289 31074 raft_consensus.cc:2362] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e92b3f0091ba47f6ad018d51785b787d in term 1. Re-sending same reply.
I20260808 05:05:44.385507 31399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:05:44.385676 31399 raft_consensus.cc:686] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [term 1 LEADER]: Becoming Leader. State: Replica: e92b3f0091ba47f6ad018d51785b787d, State: Running, Role: LEADER
I20260808 05:05:44.385758 31399 consensus_queue.cc:237] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } }
I20260808 05:05:44.386144 31399 sys_catalog.cc:455] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [sys.catalog]: SysCatalogTable state changed. Reason: New leader e92b3f0091ba47f6ad018d51785b787d. Latest consensus state: current_term: 1 leader_uuid: "e92b3f0091ba47f6ad018d51785b787d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.386214 31399 sys_catalog.cc:458] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:44.386564 31421 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:05:44.386775 31421 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:05:44.390203 31309 raft_consensus.cc:1261] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [term 1 FOLLOWER]: Refusing update from remote peer e92b3f0091ba47f6ad018d51785b787d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:05:44.390506 31074 raft_consensus.cc:1261] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [term 1 FOLLOWER]: Refusing update from remote peer e92b3f0091ba47f6ad018d51785b787d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:05:44.391002 31399 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:05:44.391168 31399 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [LEADER]: Connected to new peer: Peer: permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 05:05:44.392625 31041 tablet.cc:2369] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:05:44.393057 31357 sys_catalog.cc:455] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [sys.catalog]: SysCatalogTable state changed. Reason: New leader e92b3f0091ba47f6ad018d51785b787d. Latest consensus state: current_term: 1 leader_uuid: "e92b3f0091ba47f6ad018d51785b787d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.393164 31357 sys_catalog.cc:458] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:05:44.394214 31372 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e92b3f0091ba47f6ad018d51785b787d. Latest consensus state: current_term: 1 leader_uuid: "e92b3f0091ba47f6ad018d51785b787d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.394299 31372 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:05:44.396267 31399 sys_catalog.cc:455] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e92b3f0091ba47f6ad018d51785b787d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.396351 31399 sys_catalog.cc:458] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:44.396818 31372 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e92b3f0091ba47f6ad018d51785b787d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.396896 31372 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:05:44.397166 31422 mvcc.cc:205] Tried to move back new op lower bound from 7316134069814816768 to 7316134069804498944. Current Snapshot: MvccSnapshot[applied={T|T < 7316134069814816768}]
I20260808 05:05:44.397382 31425 mvcc.cc:205] Tried to move back new op lower bound from 7316134069814816768 to 7316134069804498944. Current Snapshot: MvccSnapshot[applied={T|T < 7316134069814816768}]
I20260808 05:05:44.397812 31399 sys_catalog.cc:455] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e92b3f0091ba47f6ad018d51785b787d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.397889 31399 sys_catalog.cc:458] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:44.398293 31357 sys_catalog.cc:455] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e92b3f0091ba47f6ad018d51785b787d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df265c12f73c47f69f69dde1e630abde" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 44329 } } peers { permanent_uuid: "e92b3f0091ba47f6ad018d51785b787d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 34981 } } peers { permanent_uuid: "cc5ae28342d348f89eb9b2a9694fe383" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 35503 } } }
I20260808 05:05:44.398376 31357 sys_catalog.cc:458] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:05:44.399066 31423 mvcc.cc:205] Tried to move back new op lower bound from 7316134069814816768 to 7316134069804498944. Current Snapshot: MvccSnapshot[applied={T|T < 7316134069814816768}]
I20260808 05:05:44.400388 31421 catalog_manager.cc:1347] Generated new cluster ID: e36bea08384745dfa9f093a0e4e7c12f
I20260808 05:05:44.400435 31421 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:05:44.430555 31421 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:05:44.431413 31421 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:05:44.436532 31421 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e92b3f0091ba47f6ad018d51785b787d: Generated new TSK 0
I20260808 05:05:44.436823 31421 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:05:45.257993 31369 catalog_manager.cc:1259] Loaded cluster ID: e36bea08384745dfa9f093a0e4e7c12f
I20260808 05:05:45.258085 31369 catalog_manager.cc:1552] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde: loading cluster ID for follower catalog manager: success
I20260808 05:05:45.259013 31369 catalog_manager.cc:1574] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde: acquiring CA information for follower catalog manager: success
I20260808 05:05:45.259369 31369 catalog_manager.cc:1602] T 00000000000000000000000000000000 P df265c12f73c47f69f69dde1e630abde: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:05:45.272117 31388 catalog_manager.cc:1259] Loaded cluster ID: e36bea08384745dfa9f093a0e4e7c12f
I20260808 05:05:45.272192 31388 catalog_manager.cc:1552] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383: loading cluster ID for follower catalog manager: success
I20260808 05:05:45.273102 31388 catalog_manager.cc:1574] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383: acquiring CA information for follower catalog manager: success
I20260808 05:05:45.273460 31388 catalog_manager.cc:1602] T 00000000000000000000000000000000 P cc5ae28342d348f89eb9b2a9694fe383: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:05:45.488535 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 31007
I20260808 05:05:45.502876 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 31130
I20260808 05:05:45.516004 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 31247
2026-08-08T05:05:45Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3169 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:05:45 dist-test-slave-7kzw krb5kdc[31443](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:05:45 dist-test-slave-7kzw krb5kdc[31443](info): set up 2 sockets
Aug 08 05:05:45 dist-test-slave-7kzw krb5kdc[31443](info): commencing operation
krb5kdc: starting...
W20260808 05:05:46.852269 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:05:46 dist-test-slave-7kzw krb5kdc[31443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:05:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:05:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:05:46.983176 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34827
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:38633
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:34827
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:47.070055 31468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:47.070286 31468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:47.070308 31468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:47.071463 31468 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:05:47.071501 31468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:47.071516 31468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:47.071528 31468 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:05:47.071540 31468 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:05:47.072988 31468 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:38633
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:34827
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34827
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:47.073196 31468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:47.073386 31468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:47.078574 31478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:47.078606 31480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:47.078552 31477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:47.078876 31468 server_base.cc:1034] running on GCE node
I20260808 05:05:47.079147 31468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:47.079459 31468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:47.080629 31468 hybrid_clock.cc:648] HybridClock initialized: now 1786165547080602 us; error 46 us; skew 500 ppm
Aug 08 05:05:47 dist-test-slave-7kzw krb5kdc[31443](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165547, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:47.083258 31468 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:05:47.083768 31468 webserver.cc:460] Webserver started at http://127.11.70.254:39453/ using document root <none> and password file <none>
I20260808 05:05:47.084002 31468 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:47.084074 31468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:47.084237 31468 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:05:47.085321 31468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "1c6ca90f87bf435eaa7e74da086a3478"
format_stamp: "Formatted at 2026-08-08 05:05:47 on dist-test-slave-7kzw"
server_key: "b5a90179a108a9754e60e431886095c8"
server_key_iv: "f5d8fb6e5ab5391d8e52e5a786e3c729"
server_key_version: "encryptionkey@0"
I20260808 05:05:47.085706 31468 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "1c6ca90f87bf435eaa7e74da086a3478"
format_stamp: "Formatted at 2026-08-08 05:05:47 on dist-test-slave-7kzw"
server_key: "b5a90179a108a9754e60e431886095c8"
server_key_iv: "f5d8fb6e5ab5391d8e52e5a786e3c729"
server_key_version: "encryptionkey@0"
I20260808 05:05:47.087217 31468 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:05:47.087993 31492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:47.088178 31468 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:47.088305 31468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "1c6ca90f87bf435eaa7e74da086a3478"
format_stamp: "Formatted at 2026-08-08 05:05:47 on dist-test-slave-7kzw"
server_key: "b5a90179a108a9754e60e431886095c8"
server_key_iv: "f5d8fb6e5ab5391d8e52e5a786e3c729"
server_key_version: "encryptionkey@0"
I20260808 05:05:47.088388 31468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:47.116695 31468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:47.118875 31468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:47.119062 31468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:47.123409 31468 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:34827
I20260808 05:05:47.123453 31562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:34827 every 8 connection(s)
I20260808 05:05:47.123859 31468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:05:47.124760 31565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:47.127468 31565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478: Bootstrap starting.
I20260808 05:05:47.128085 31565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:47.128407 31565 log.cc:824] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:47.129117 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 31468
I20260808 05:05:47.129237 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:05:47.129294 31565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478: No bootstrap required, opened a new log
I20260808 05:05:47.129464 11547 external_mini_cluster.cc:1428] Setting key 9f832b538b22835f644ace1ba24abfe2
I20260808 05:05:47.131974 31565 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6ca90f87bf435eaa7e74da086a3478" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34827 } }
I20260808 05:05:47.132114 31565 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:47.132136 31565 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c6ca90f87bf435eaa7e74da086a3478, State: Initialized, Role: FOLLOWER
I20260808 05:05:47.132265 31565 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6ca90f87bf435eaa7e74da086a3478" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34827 } }
I20260808 05:05:47.132346 31565 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:05:47.132369 31565 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:05:47.132432 31565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:47.133064 31565 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6ca90f87bf435eaa7e74da086a3478" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34827 } }
I20260808 05:05:47.133157 31565 leader_election.cc:302] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c6ca90f87bf435eaa7e74da086a3478; no voters:
I20260808 05:05:47.133356 31565 leader_election.cc:288] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:05:47.133380 31572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:05:47.133594 31572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [term 1 LEADER]: Becoming Leader. State: Replica: 1c6ca90f87bf435eaa7e74da086a3478, State: Running, Role: LEADER
I20260808 05:05:47.133711 31565 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:05:47.133754 31572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6ca90f87bf435eaa7e74da086a3478" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34827 } }
I20260808 05:05:47.134130 31572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c6ca90f87bf435eaa7e74da086a3478. Latest consensus state: current_term: 1 leader_uuid: "1c6ca90f87bf435eaa7e74da086a3478" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6ca90f87bf435eaa7e74da086a3478" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34827 } } }
I20260808 05:05:47.134145 31573 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c6ca90f87bf435eaa7e74da086a3478" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c6ca90f87bf435eaa7e74da086a3478" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34827 } } }
I20260808 05:05:47.134333 31573 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:47.134593 31572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478 [sys.catalog]: This master's current role is: LEADER
W20260808 05:05:47.135643 31598 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:05:47.135706 31598 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:05:47.135926 31583 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:05:47.136140 31583 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:05:47.137631 31583 catalog_manager.cc:1347] Generated new cluster ID: a08aee6c7e3c4becb04e9ae1c3e61182
I20260808 05:05:47.137684 31583 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:05:47 dist-test-slave-7kzw krb5kdc[31443](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165546, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:47.142064 31570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:47.129982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60924 (local address 127.11.70.254:34827)
0808 05:05:47.130185 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:47.130194 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:47.130225 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:05:47.130824 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:47.130832 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:47.130882 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:47.130996 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:47.131855 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:47.133294 (+ 1439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:47.134381 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:47.135065 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:47.135149 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:47.138309 (+ 3160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:47.138313 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:47.138313 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:47.138325 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:47.140363 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:47.140796 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:47.140799 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:47.140799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:47.140900 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:47.141147 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:47.141148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:47.141148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:47.141438 (+ 290us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:47.141589 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:47.141732 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:05:47.141866 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":115,"threads_started":1}
I20260808 05:05:47.143062 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:05:47.152851 31583 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:05:47.153389 31583 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:05:47.165736 31583 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1c6ca90f87bf435eaa7e74da086a3478: Generated new TSK 0
I20260808 05:05:47.165961 31583 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:05:47.197369 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 31468
2026-08-08T05:05:47Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1684 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:05:47 dist-test-slave-7kzw krb5kdc[31607](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:05:47 dist-test-slave-7kzw krb5kdc[31607](info): set up 2 sockets
Aug 08 05:05:47 dist-test-slave-7kzw krb5kdc[31607](info): commencing operation
krb5kdc: starting...
W20260808 05:05:48.508594 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.282s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:05:48 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:05:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:05:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:05:48.639184 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:40099
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:40099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:48.723721 31628 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:48.723933 31628 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:48.723955 31628 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:48.725104 31628 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:05:48.725149 31628 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:48.725163 31628 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:48.725176 31628 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:05:48.725188 31628 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:05:48.726773 31628 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:40099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:40099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31628
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:48.727027 31628 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:48.727279 31628 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:48.732363 31635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:48.732374 31633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:48.732358 31639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:48.732697 31628 server_base.cc:1034] running on GCE node
I20260808 05:05:48.733012 31628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:48.733315 31628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:48.734521 31628 hybrid_clock.cc:648] HybridClock initialized: now 1786165548734512 us; error 59 us; skew 500 ppm
Aug 08 05:05:48 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:48.737069 31628 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:05:48.737541 31628 webserver.cc:460] Webserver started at http://127.11.70.254:40875/ using document root <none> and password file <none>
I20260808 05:05:48.737782 31628 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:48.737852 31628 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:48.738009 31628 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:05:48.739159 31628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "810c351c43fc419aaf71fd6b103296e2"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "69779cb56568e53a05e4cee542463acc"
server_key_iv: "73a6e3d2d58a7d102511c9ac0e6757fb"
server_key_version: "encryptionkey@0"
I20260808 05:05:48.739538 31628 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "810c351c43fc419aaf71fd6b103296e2"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "69779cb56568e53a05e4cee542463acc"
server_key_iv: "73a6e3d2d58a7d102511c9ac0e6757fb"
server_key_version: "encryptionkey@0"
I20260808 05:05:48.740912 31628 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:05:48.741760 31646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:48.741951 31628 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:48.742063 31628 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "810c351c43fc419aaf71fd6b103296e2"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "69779cb56568e53a05e4cee542463acc"
server_key_iv: "73a6e3d2d58a7d102511c9ac0e6757fb"
server_key_version: "encryptionkey@0"
I20260808 05:05:48.742146 31628 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:48.753545 31628 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:48.755954 31628 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:48.756148 31628 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:48.760262 31628 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:40099
I20260808 05:05:48.760341 31722 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:40099 every 8 connection(s)
I20260808 05:05:48.760695 31628 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:05:48.761772 31723 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:48.764148 31723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Bootstrap starting.
I20260808 05:05:48.764698 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 31628
I20260808 05:05:48.764755 31723 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:48.764848 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:05:48.765060 11547 external_mini_cluster.cc:1428] Setting key 435db69f4f42cf102fcee4cf686c10e6
I20260808 05:05:48.765090 31723 log.cc:824] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:48.765956 31723 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: No bootstrap required, opened a new log
I20260808 05:05:48.768558 31723 raft_consensus.cc:348] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:48.768736 31723 raft_consensus.cc:374] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:48.768766 31723 raft_consensus.cc:729] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810c351c43fc419aaf71fd6b103296e2, State: Initialized, Role: FOLLOWER
I20260808 05:05:48.768886 31723 consensus_queue.cc:260] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:48.768991 31723 raft_consensus.cc:388] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:05:48.769057 31723 raft_consensus.cc:482] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:05:48.769109 31723 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:48.769721 31723 raft_consensus.cc:504] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:48.769829 31723 leader_election.cc:302] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 810c351c43fc419aaf71fd6b103296e2; no voters:
I20260808 05:05:48.769989 31723 leader_election.cc:288] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:05:48.770041 31728 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:05:48.770236 31723 sys_catalog.cc:564] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:05:48.770243 31728 raft_consensus.cc:686] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 1 LEADER]: Becoming Leader. State: Replica: 810c351c43fc419aaf71fd6b103296e2, State: Running, Role: LEADER
I20260808 05:05:48.770509 31728 consensus_queue.cc:237] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:48.770921 31729 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "810c351c43fc419aaf71fd6b103296e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } } }
I20260808 05:05:48.771090 31730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 810c351c43fc419aaf71fd6b103296e2. Latest consensus state: current_term: 1 leader_uuid: "810c351c43fc419aaf71fd6b103296e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } } }
I20260808 05:05:48.771180 31729 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:48.771220 31730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:48.771513 31742 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:05:48.772071 31742 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 05:05:48 dist-test-slave-7kzw krb5kdc[31607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165548, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:48.774533 31754 mvcc.cc:205] Tried to move back new op lower bound from 7316134087774408704 to 7316134087764561920. Current Snapshot: MvccSnapshot[applied={T|T < 7316134087774408704 or (T in {7316134087774408704})}]
I20260808 05:05:48.775519 31742 catalog_manager.cc:1347] Generated new cluster ID: d82bad470f2e46b99671e835f3e55169
I20260808 05:05:48.775590 31742 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:05:48.777559 31727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:48.765632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38658 (local address 127.11.70.254:40099)
0808 05:05:48.765848 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:48.765858 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:48.765892 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:05:48.766455 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:48.766464 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:48.766551 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:48.766706 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:48.767412 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:48.768827 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:48.769688 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:48.770355 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:48.770834 (+ 479us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:48.773587 (+ 2753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:48.773590 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:48.773591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:48.773601 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:48.775418 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:48.775846 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:48.775850 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:48.775850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:48.775959 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:48.776184 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:48.776185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:48.776185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:48.776507 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:48.776658 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:48.777188 (+ 530us) server_negotiation.cc:299] Negotiation successful
0808 05:05:48.777330 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":104,"threads_started":1}
I20260808 05:05:48.803670 31742 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:05:48.804455 31742 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:05:48.812757 31742 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Generated new TSK 0
I20260808 05:05:48.812970 31742 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:05:48.845350 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:40099
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:48.931249 31761 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:48.931447 31761 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:48.931471 31761 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:48.932613 31761 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:48.932659 31761 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:48.932685 31761 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:05:48.934151 31761 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31761
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:48.934417 31761 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:48.934701 31761 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:48.940037 31766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:48.940044 31772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:48.940083 31767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:48.940574 31761 server_base.cc:1034] running on GCE node
I20260808 05:05:48.940785 31761 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:48.940994 31761 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:48.942147 31761 hybrid_clock.cc:648] HybridClock initialized: now 1786165548942136 us; error 35 us; skew 500 ppm
Aug 08 05:05:48 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:48.949590 31761 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:05:48.950119 31761 webserver.cc:460] Webserver started at http://127.11.70.193:44849/ using document root <none> and password file <none>
I20260808 05:05:48.950425 31761 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:48.950529 31761 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:48.950706 31761 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:05:48.951884 31761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "b13e18e878a74e55b03e5d67a3f2ea3e"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "1919f88f3102e4b7a3df929c5b48301a"
server_key_iv: "3c1c0c703a12ce17a49f572cbb56458e"
server_key_version: "encryptionkey@0"
I20260808 05:05:48.952299 31761 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "b13e18e878a74e55b03e5d67a3f2ea3e"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "1919f88f3102e4b7a3df929c5b48301a"
server_key_iv: "3c1c0c703a12ce17a49f572cbb56458e"
server_key_version: "encryptionkey@0"
I20260808 05:05:48.953758 31761 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:05:48.954619 31781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:48.954845 31761 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:05:48.954969 31761 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "b13e18e878a74e55b03e5d67a3f2ea3e"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "1919f88f3102e4b7a3df929c5b48301a"
server_key_iv: "3c1c0c703a12ce17a49f572cbb56458e"
server_key_version: "encryptionkey@0"
I20260808 05:05:48.955066 31761 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:48.964702 31761 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:48.966681 31761 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:48.966850 31761 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:48.967093 31761 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:48.967484 31761 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:48.967553 31761 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:48.967600 31761 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:48.967633 31761 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:48.974498 31761 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:38089
I20260808 05:05:48.974596 31940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:38089 every 8 connection(s)
I20260808 05:05:48.974947 31761 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:05:48 dist-test-slave-7kzw krb5kdc[31607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165548, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:48.981587 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 31761
I20260808 05:05:48.981688 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:05:48.981931 11547 external_mini_cluster.cc:1428] Setting key 3333d2a51b28ce9d89f5b8b671621a30
I20260808 05:05:48.985210 31727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:48.975810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:47809 (local address 127.11.70.254:40099)
0808 05:05:48.975883 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:48.975885 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:48.976116 (+ 231us) server_negotiation.cc:407] Connection header received
0808 05:05:48.976620 (+ 504us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:48.976621 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:48.976631 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:48.976684 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:48.977689 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:48.978181 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:48.979264 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:48.979464 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:48.979520 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:48.981770 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:48.981772 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:48.981773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:48.981782 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:48.983567 (+ 1785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:48.984055 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:48.984057 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:48.984057 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:48.984140 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:48.984485 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:48.984486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:48.984486 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:48.984622 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:48.984685 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:48.985069 (+ 384us) server_negotiation.cc:299] Negotiation successful
0808 05:05:48.985142 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:05:48.985545 31943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:48.975791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:47809)
0808 05:05:48.975967 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:48.976015 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:48.976535 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:48.976751 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:48.976755 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:48.977392 (+ 637us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:48.977605 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:48.977609 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:48.978270 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:48.978271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:48.979179 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:48.979181 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:48.979547 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:48.979548 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:48.979652 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:48.980118 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:48.980127 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:48.981602 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:48.983682 (+ 2080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:48.983690 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:48.983692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:48.983952 (+ 260us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:48.984226 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:48.984227 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:48.984227 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:48.984395 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:48.984701 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:48.984708 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:48.984907 (+ 199us) client_negotiation.cc:769] Sending connection context
0808 05:05:48.985047 (+ 140us) client_negotiation.cc:240] Negotiation successful
0808 05:05:48.985246 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
I20260808 05:05:48.986164 31941 heartbeater.cc:347] Connected to a master server at 127.11.70.254:40099
I20260808 05:05:48.986290 31941 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:48.986526 31941 heartbeater.cc:511] Master 127.11.70.254:40099 requested a full tablet report, sending...
I20260808 05:05:48.987126 31672 ts_manager.cc:194] Registered new tserver with Master: b13e18e878a74e55b03e5d67a3f2ea3e (127.11.70.193:38089)
I20260808 05:05:48.987769 31672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:47809
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:05:49.015012 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:40099
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:49.101917 31946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:49.102137 31946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:49.102161 31946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:49.103353 31946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:49.103400 31946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:49.103427 31946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:05:49.104916 31946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:49.105187 31946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:49.105463 31946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:49.111016 31960 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.111071 31953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.111105 31956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:49.111104 31946 server_base.cc:1034] running on GCE node
I20260808 05:05:49.111543 31946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:49.111795 31946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:49.112969 31946 hybrid_clock.cc:648] HybridClock initialized: now 1786165549112966 us; error 40 us; skew 500 ppm
Aug 08 05:05:49 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:49.115849 31946 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:05:49.116334 31946 webserver.cc:460] Webserver started at http://127.11.70.194:33927/ using document root <none> and password file <none>
I20260808 05:05:49.116592 31946 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:49.116670 31946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:49.116822 31946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:05:49.117890 31946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "e5d5e411f9fb436b80072ab009cece23"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "f4ea3d14bbea9e4bad43c8cc202cad5f"
server_key_iv: "bdb726ee344072dbbbb9a31e13d0491c"
server_key_version: "encryptionkey@0"
I20260808 05:05:49.118258 31946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "e5d5e411f9fb436b80072ab009cece23"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "f4ea3d14bbea9e4bad43c8cc202cad5f"
server_key_iv: "bdb726ee344072dbbbb9a31e13d0491c"
server_key_version: "encryptionkey@0"
I20260808 05:05:49.119768 31946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:49.120607 31971 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.120879 31946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:49.120959 31946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "e5d5e411f9fb436b80072ab009cece23"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "f4ea3d14bbea9e4bad43c8cc202cad5f"
server_key_iv: "bdb726ee344072dbbbb9a31e13d0491c"
server_key_version: "encryptionkey@0"
I20260808 05:05:49.121014 31946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:49.133049 31946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:49.135428 31946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:49.135542 31946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:49.135739 31946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:49.136053 31946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:49.136091 31946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.136116 31946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:49.136170 31946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.142342 31946 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:43303
I20260808 05:05:49.142388 32150 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:43303 every 8 connection(s)
I20260808 05:05:49.142730 31946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:05:49 dist-test-slave-7kzw krb5kdc[31607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:49.151208 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 31946
I20260808 05:05:49.151335 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:05:49.151561 11547 external_mini_cluster.cc:1428] Setting key dec0173e91c0b4618769e2e60a068775
I20260808 05:05:49.153537 32156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.143428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:41033)
0808 05:05:49.143642 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.143692 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.144401 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.144687 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.144691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.145325 (+ 634us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:49.145563 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.145568 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.146300 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.146301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.147177 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.147179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.147587 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.147589 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.147720 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.148234 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:49.148243 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:49.149700 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:49.151804 (+ 2104us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:49.151819 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:49.151821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:49.152196 (+ 375us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:49.152497 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:49.152498 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:49.152498 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:49.152644 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:49.152981 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:49.152986 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:49.153121 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.153214 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.153358 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":110,"threads_started":1}
I20260808 05:05:49.153542 31727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.143509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:41033 (local address 127.11.70.254:40099)
0808 05:05:49.143597 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.143600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.143785 (+ 185us) server_negotiation.cc:407] Connection header received
0808 05:05:49.144551 (+ 766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.144553 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.144567 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.144618 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:49.145676 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.146197 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.147296 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.147498 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.147580 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.149812 (+ 2232us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:49.149813 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:49.149814 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:49.149827 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:49.151706 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.152328 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.152330 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.152331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.152409 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.152725 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.152726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.152727 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.152901 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:49.152987 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.153266 (+ 279us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.153382 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:05:49.154188 32153 heartbeater.cc:347] Connected to a master server at 127.11.70.254:40099
I20260808 05:05:49.154313 32153 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:49.154558 32153 heartbeater.cc:511] Master 127.11.70.254:40099 requested a full tablet report, sending...
I20260808 05:05:49.155038 31672 ts_manager.cc:194] Registered new tserver with Master: e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303)
I20260808 05:05:49.155647 31672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:41033
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:05:49.182984 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:40099
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:49.269724 32159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:49.269992 32159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:49.270018 32159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:49.271487 32159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:49.271543 32159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:49.271570 32159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:05:49.273336 32159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:49.273620 32159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:49.273864 32159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:49.279531 32166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.279666 32169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.279567 32173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:49.279984 32159 server_base.cc:1034] running on GCE node
I20260808 05:05:49.280210 32159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:49.280463 32159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:49.281667 32159 hybrid_clock.cc:648] HybridClock initialized: now 1786165549281657 us; error 39 us; skew 500 ppm
Aug 08 05:05:49 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:49.284461 32159 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:05:49.285002 32159 webserver.cc:460] Webserver started at http://127.11.70.195:44565/ using document root <none> and password file <none>
I20260808 05:05:49.285267 32159 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:49.285342 32159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:49.285493 32159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:05:49.286659 32159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "fba274560e9246f0b69fa3cd4fd518e7"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "1ce1c002d4fdabecfd99ce7090f56bda"
server_key_iv: "373106cfe4e74e7942a1d2cbbd54f7bd"
server_key_version: "encryptionkey@0"
I20260808 05:05:49.287029 32159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "fba274560e9246f0b69fa3cd4fd518e7"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "1ce1c002d4fdabecfd99ce7090f56bda"
server_key_iv: "373106cfe4e74e7942a1d2cbbd54f7bd"
server_key_version: "encryptionkey@0"
I20260808 05:05:49.288462 32159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:05:49.289345 32181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.289526 32159 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:49.289675 32159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "fba274560e9246f0b69fa3cd4fd518e7"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "1ce1c002d4fdabecfd99ce7090f56bda"
server_key_iv: "373106cfe4e74e7942a1d2cbbd54f7bd"
server_key_version: "encryptionkey@0"
I20260808 05:05:49.289763 32159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:49.298421 32159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:49.300716 32159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:49.300894 32159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:49.301146 32159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:49.301478 32159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:49.301533 32159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.301570 32159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:49.301620 32159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.307916 32159 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:38331
I20260808 05:05:49.307962 32342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:38331 every 8 connection(s)
I20260808 05:05:49.308295 32159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:05:49.308887 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 32159
I20260808 05:05:49.308996 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:05:49.309231 11547 external_mini_cluster.cc:1428] Setting key 36cbea28fed781c6d7b3e45abadf41f0
Aug 08 05:05:49 dist-test-slave-7kzw krb5kdc[31607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:49.318800 31727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.309096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:50129 (local address 127.11.70.254:40099)
0808 05:05:49.309176 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.309179 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.309430 (+ 251us) server_negotiation.cc:407] Connection header received
0808 05:05:49.310245 (+ 815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.310246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.310259 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.310309 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:49.311495 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.312053 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.313335 (+ 1282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.313535 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.313607 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.316100 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:49.316101 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:49.316101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:49.316108 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:49.317436 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.317853 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.317854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.317854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.317908 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.318163 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.318164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.318165 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.318284 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:49.318350 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.318659 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.318730 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:05:49.318945 32346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.309069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:50129)
0808 05:05:49.309280 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.309340 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.310118 (+ 778us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.310385 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.310390 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.311159 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:49.311371 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.311376 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.312168 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.312170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.313227 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.313230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.313647 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.313648 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.313774 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.314394 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:49.314403 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:49.316001 (+ 1598us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:49.317531 (+ 1530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:49.317540 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:49.317542 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:49.317782 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:49.317969 (+ 187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:49.317969 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:49.317970 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:49.318076 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:49.318350 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:49.318355 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:49.318518 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.318621 (+ 103us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.318746 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":114,"threads_started":1}
I20260808 05:05:49.319514 32343 heartbeater.cc:347] Connected to a master server at 127.11.70.254:40099
I20260808 05:05:49.319658 32343 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:49.319801 32343 heartbeater.cc:511] Master 127.11.70.254:40099 requested a full tablet report, sending...
I20260808 05:05:49.320123 31672 ts_manager.cc:194] Registered new tserver with Master: fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331)
I20260808 05:05:49.320478 31672 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:50129
I20260808 05:05:49.321262 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:05:49.328644 31727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.322642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38674 (local address 127.11.70.254:40099)
0808 05:05:49.322705 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.322707 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.322805 (+ 98us) server_negotiation.cc:407] Connection header received
0808 05:05:49.322842 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.322843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.322851 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.322894 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:49.323389 (+ 495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.323915 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.324652 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.324894 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.324948 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.326045 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:49.326047 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:49.326047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:49.326053 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:49.327473 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.327783 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.327784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.327784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.327832 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.327996 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.327997 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.327997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.328135 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:49.328215 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.328405 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.328508 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:05:49.330219 31672 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38674:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:05:49.331825 31672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:05:49.339529 32359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.334503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:38331 (local address 127.0.0.1:45002)
0808 05:05:49.334753 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.334762 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.334803 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.335424 (+ 621us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.335429 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.335432 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:49.335501 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.335503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.336837 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.336838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.338080 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.338084 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.339173 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.339174 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.339287 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.339307 (+ 20us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.339364 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.339431 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":87,"threads_started":1}
I20260808 05:05:49.340022 32365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.334870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45002 (local address 127.11.70.195:38331)
0808 05:05:49.335159 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.335164 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.335174 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:05:49.335242 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.335245 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.335262 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.335602 (+ 340us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:49.335663 (+ 61us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.336714 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.338196 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.339061 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.339760 (+ 699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.339848 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.339877 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.339920 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":222,"thread_start_us":103,"threads_started":1}
I20260808 05:05:49.340871 32361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.334511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:38089 (local address 127.0.0.1:49820)
0808 05:05:49.334900 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.334908 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.334943 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.336429 (+ 1486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.336430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.336433 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:49.336479 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.336480 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.338421 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.338422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.339654 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.339657 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.340651 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.340652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.340720 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.340725 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.340756 (+ 31us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.340795 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":114,"threads_started":1}
I20260808 05:05:49.341276 32364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.334759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49820 (local address 127.11.70.193:38089)
0808 05:05:49.336248 (+ 1489us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.336254 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.336264 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:05:49.336304 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.336306 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.336323 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.336553 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:49.336647 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.338254 (+ 1607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.339770 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.340530 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.341045 (+ 515us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.341119 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.341147 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.341189 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1442,"thread_start_us":100,"threads_started":1}
I20260808 05:05:49.348030 31851 tablet_service.cc:1467] Processing CreateTablet for tablet e26909f047b54123894389300b18849f (DEFAULT_TABLE table=test-table [id=f37d6df1a4c7481f80e2d11b67d209ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:05:49.348047 32247 tablet_service.cc:1467] Processing CreateTablet for tablet e26909f047b54123894389300b18849f (DEFAULT_TABLE table=test-table [id=f37d6df1a4c7481f80e2d11b67d209ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:05:49.348472 31851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e26909f047b54123894389300b18849f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:49.348481 32247 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e26909f047b54123894389300b18849f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:49.350749 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.334460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:43303 (local address 127.0.0.1:48400)
0808 05:05:49.334677 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.334718 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.334787 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.346312 (+ 11525us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.346314 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.346317 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:49.346379 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.346382 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.347986 (+ 1604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.347987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.349230 (+ 1243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.349233 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.350398 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.350399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.350519 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.350525 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.350583 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.350630 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":80,"threads_started":1}
I20260808 05:05:49.351148 32363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.334636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48400 (local address 127.11.70.194:43303)
0808 05:05:49.335000 (+ 364us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.335005 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.335018 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:05:49.335063 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.335065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.335993 (+ 928us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.336089 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:49.346528 (+ 10439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.347852 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.349352 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.350200 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.350257 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.350319 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.350936 (+ 617us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.350984 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":321,"thread_start_us":86,"threads_started":1}
I20260808 05:05:49.351856 32048 tablet_service.cc:1467] Processing CreateTablet for tablet e26909f047b54123894389300b18849f (DEFAULT_TABLE table=test-table [id=f37d6df1a4c7481f80e2d11b67d209ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:05:49.352221 32048 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e26909f047b54123894389300b18849f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:49.352384 32366 tablet_bootstrap.cc:492] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: Bootstrap starting.
I20260808 05:05:49.353185 32366 tablet_bootstrap.cc:654] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:49.353856 32366 log.cc:824] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:49.354626 32368 tablet_bootstrap.cc:492] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Bootstrap starting.
I20260808 05:05:49.354808 32366 tablet_bootstrap.cc:492] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: No bootstrap required, opened a new log
I20260808 05:05:49.354890 32366 ts_tablet_manager.cc:1397] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:05:49.355290 32368 tablet_bootstrap.cc:654] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:49.355877 32368 log.cc:824] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:49.356590 32371 tablet_bootstrap.cc:492] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: Bootstrap starting.
I20260808 05:05:49.356688 32368 tablet_bootstrap.cc:492] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: No bootstrap required, opened a new log
I20260808 05:05:49.356743 32368 ts_tablet_manager.cc:1397] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:05:49.357236 32371 tablet_bootstrap.cc:654] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:49.357107 32366 raft_consensus.cc:348] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.357318 32366 raft_consensus.cc:374] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:49.357365 32366 raft_consensus.cc:729] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fba274560e9246f0b69fa3cd4fd518e7, State: Initialized, Role: FOLLOWER
I20260808 05:05:49.357512 32366 consensus_queue.cc:260] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.357903 32371 log.cc:824] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:49.357895 32366 ts_tablet_manager.cc:1428] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:05:49.357908 32343 heartbeater.cc:503] Master 127.11.70.254:40099 was elected leader, sending a full tablet report...
I20260808 05:05:49.359275 32368 raft_consensus.cc:348] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.359431 32371 tablet_bootstrap.cc:492] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: No bootstrap required, opened a new log
I20260808 05:05:49.359436 32368 raft_consensus.cc:374] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:49.359474 32368 raft_consensus.cc:729] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13e18e878a74e55b03e5d67a3f2ea3e, State: Initialized, Role: FOLLOWER
I20260808 05:05:49.359490 32371 ts_tablet_manager.cc:1397] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:05:49.359606 32368 consensus_queue.cc:260] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.359891 32368 ts_tablet_manager.cc:1428] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:05:49.359952 31941 heartbeater.cc:503] Master 127.11.70.254:40099 was elected leader, sending a full tablet report...
I20260808 05:05:49.361375 32371 raft_consensus.cc:348] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.361493 32371 raft_consensus.cc:374] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:49.361514 32371 raft_consensus.cc:729] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d5e411f9fb436b80072ab009cece23, State: Initialized, Role: FOLLOWER
I20260808 05:05:49.361652 32371 consensus_queue.cc:260] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.361948 32371 ts_tablet_manager.cc:1428] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:05:49.361974 32153 heartbeater.cc:503] Master 127.11.70.254:40099 was elected leader, sending a full tablet report...
I20260808 05:05:49.392771 32374 raft_consensus.cc:482] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:05:49.392944 32374 raft_consensus.cc:504] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
W20260808 05:05:49.393395 32155 tablet.cc:2369] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:05:49.393438 32374 leader_election.cc:288] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303), b13e18e878a74e55b03e5d67a3f2ea3e (127.11.70.193:38089)
I20260808 05:05:49.396610 32346 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.393610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:43303 (local address 127.11.70.195:46017)
0808 05:05:49.393711 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.393737 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.393786 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.393984 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.393986 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.393988 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:49.394061 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.394063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.394991 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.394992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.395744 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.395746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.396330 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.396331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.396413 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.396418 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.396471 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.396518 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":78}
I20260808 05:05:49.397179 32363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.393731 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:46017 (local address 127.11.70.194:43303)
0808 05:05:49.393847 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.393849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.393860 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:05:49.393890 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.393891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.393902 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.393961 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:49.394136 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.394920 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.395844 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.396245 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.396334 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.396343 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.397074 (+ 731us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.397116 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260808 05:05:49.397490 32080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e26909f047b54123894389300b18849f" candidate_uuid: "fba274560e9246f0b69fa3cd4fd518e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d5e411f9fb436b80072ab009cece23" is_pre_election: true
I20260808 05:05:49.397678 32080 raft_consensus.cc:2454] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fba274560e9246f0b69fa3cd4fd518e7 in term 0.
I20260808 05:05:49.397780 32379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.393649 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:38089 (local address 127.11.70.195:46371)
0808 05:05:49.393826 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.393837 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.393881 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.394097 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.394098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.394101 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:49.394181 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.394184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.395272 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.395273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.396720 (+ 1447us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.396724 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.397495 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.397496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.397598 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.397603 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.397658 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.397696 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":13,"thread_start_us":122,"threads_started":1}
I20260808 05:05:49.397769 32364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.393882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:46371 (local address 127.11.70.193:38089)
0808 05:05:49.393938 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.393940 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.393950 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:05:49.393978 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.393980 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.393990 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.394042 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:49.394278 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.395153 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.396824 (+ 1671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.397370 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.397439 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.397447 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.397666 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.397706 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:05:49.397950 32185 leader_election.cc:302] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5d5e411f9fb436b80072ab009cece23, fba274560e9246f0b69fa3cd4fd518e7; no voters:
I20260808 05:05:49.398097 32374 raft_consensus.cc:2781] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:05:49.398166 32374 raft_consensus.cc:482] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:05:49.398204 32374 raft_consensus.cc:3037] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:49.398310 31877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e26909f047b54123894389300b18849f" candidate_uuid: "fba274560e9246f0b69fa3cd4fd518e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" is_pre_election: true
I20260808 05:05:49.398447 31877 raft_consensus.cc:2454] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fba274560e9246f0b69fa3cd4fd518e7 in term 0.
I20260808 05:05:49.399279 32374 raft_consensus.cc:504] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.399435 32374 leader_election.cc:288] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [CANDIDATE]: Term 1 election: Requested vote from peers e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303), b13e18e878a74e55b03e5d67a3f2ea3e (127.11.70.193:38089)
I20260808 05:05:49.399587 32080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e26909f047b54123894389300b18849f" candidate_uuid: "fba274560e9246f0b69fa3cd4fd518e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5d5e411f9fb436b80072ab009cece23"
I20260808 05:05:49.399608 31877 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e26909f047b54123894389300b18849f" candidate_uuid: "fba274560e9246f0b69fa3cd4fd518e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e"
I20260808 05:05:49.399679 31877 raft_consensus.cc:3037] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:49.399673 32080 raft_consensus.cc:3037] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:49.400337 31877 raft_consensus.cc:2454] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fba274560e9246f0b69fa3cd4fd518e7 in term 1.
I20260808 05:05:49.400508 32188 leader_election.cc:302] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b13e18e878a74e55b03e5d67a3f2ea3e, fba274560e9246f0b69fa3cd4fd518e7; no voters:
I20260808 05:05:49.400601 32374 raft_consensus.cc:2781] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:05:49.400756 32374 raft_consensus.cc:686] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 1 LEADER]: Becoming Leader. State: Replica: fba274560e9246f0b69fa3cd4fd518e7, State: Running, Role: LEADER
I20260808 05:05:49.400786 32080 raft_consensus.cc:2454] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fba274560e9246f0b69fa3cd4fd518e7 in term 1.
I20260808 05:05:49.400842 32374 consensus_queue.cc:237] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.401587 31672 catalog_manager.cc:5495] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "fba274560e9246f0b69fa3cd4fd518e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } health_report { overall_health: UNKNOWN } } }
I20260808 05:05:49.412400 32365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.410293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45008 (local address 127.11.70.195:38331)
0808 05:05:49.410337 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.410340 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.410369 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:05:49.410406 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.410406 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.410422 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.410520 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:05:49.410649 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.411087 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.411795 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.411976 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.412030 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.412130 (+ 100us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:05:49.412218 (+ 88us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:05:49.412274 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.412308 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.412323 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:05:49.414126 32080 raft_consensus.cc:1261] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [term 1 FOLLOWER]: Refusing update from remote peer fba274560e9246f0b69fa3cd4fd518e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:05:49.414155 31877 raft_consensus.cc:1261] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Refusing update from remote peer fba274560e9246f0b69fa3cd4fd518e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:05:49.414455 32381 consensus_queue.cc:1035] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:05:49.414680 32374 consensus_queue.cc:1035] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:05:49.417034 32386 mvcc.cc:205] Tried to move back new op lower bound from 7316134090397585408 to 7316134090346545152. Current Snapshot: MvccSnapshot[applied={T|T < 7316134090397585408}]
I20260808 05:05:49.417088 32387 mvcc.cc:205] Tried to move back new op lower bound from 7316134090397585408 to 7316134090346545152. Current Snapshot: MvccSnapshot[applied={T|T < 7316134090397585408}]
I20260808 05:05:49.420055 31672 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:05:49.420158 31672 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38674:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:05:49.420917 31672 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Sending DeleteTablet for 3 replicas of tablet e26909f047b54123894389300b18849f
I20260808 05:05:49.421254 32247 tablet_service.cc:1514] Processing DeleteTablet for tablet e26909f047b54123894389300b18849f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:05:49 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:45002
I20260808 05:05:49.421301 32048 tablet_service.cc:1514] Processing DeleteTablet for tablet e26909f047b54123894389300b18849f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:05:49 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:48400
I20260808 05:05:49.421509 32399 tablet_replica.cc:330] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: stopping tablet replica
I20260808 05:05:49.421510 31851 tablet_service.cc:1514] Processing DeleteTablet for tablet e26909f047b54123894389300b18849f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:05:49 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:49820
I20260808 05:05:49.421630 32399 raft_consensus.cc:2229] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:05:49.421703 32402 tablet_replica.cc:330] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: stopping tablet replica
I20260808 05:05:49.421780 32397 tablet_replica.cc:330] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: stopping tablet replica
I20260808 05:05:49.421816 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 31761
I20260808 05:05:49.421904 32397 raft_consensus.cc:2229] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:05:49.432626 32399 raft_consensus.cc:2258] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:05:49.432808 32397 raft_consensus.cc:2258] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:05:49.433943 32397 ts_tablet_manager.cc:1905] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:05:49.435626 32397 ts_tablet_manager.cc:1918] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:05:49.435695 32397 log.cc:1196] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/e26909f047b54123894389300b18849f
I20260808 05:05:49.435992 32397 ts_tablet_manager.cc:1939] T e26909f047b54123894389300b18849f P fba274560e9246f0b69fa3cd4fd518e7: Deleting consensus metadata
I20260808 05:05:49.436419 31651 catalog_manager.cc:4841] TS fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331): tablet e26909f047b54123894389300b18849f (table test-table [id=f37d6df1a4c7481f80e2d11b67d209ee]) successfully deleted
I20260808 05:05:49.437664 32399 ts_tablet_manager.cc:1905] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:05:49.439245 32399 ts_tablet_manager.cc:1918] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:05:49.439316 32399 log.cc:1196] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/e26909f047b54123894389300b18849f
I20260808 05:05:49.439579 32399 ts_tablet_manager.cc:1939] T e26909f047b54123894389300b18849f P e5d5e411f9fb436b80072ab009cece23: Deleting consensus metadata
I20260808 05:05:49.440625 31648 catalog_manager.cc:4841] TS e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303): tablet e26909f047b54123894389300b18849f (table test-table [id=f37d6df1a4c7481f80e2d11b67d209ee]) successfully deleted
W20260808 05:05:49.446379 31649 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:38089 (error 108)
I20260808 05:05:49.446996 32362 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.446837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:38089 (local address 127.0.0.1:49834)
0808 05:05:49.446907 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.446952 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:38089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 05:05:49.447047 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 31946
W20260808 05:05:49.451789 31649 catalog_manager.cc:4584] TS b13e18e878a74e55b03e5d67a3f2ea3e (127.11.70.193:38089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e26909f047b54123894389300b18849f: Network error: Client connection negotiation failed: client connection to 127.11.70.193:38089: connect: Connection refused (error 111)
I20260808 05:05:49.460522 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 32159
I20260808 05:05:49.468950 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 31628
I20260808 05:05:49.479269 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:40099
--webserver_interface=127.11.70.254
--webserver_port=40875
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:40099
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:49.561321 32406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:49.561589 32406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:49.561623 32406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:49.562775 32406 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:05:49.562855 32406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:49.562878 32406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:49.562901 32406 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:05:49.562929 32406 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:05:49.564397 32406 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:40099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:40099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=40875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:49.564689 32406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:49.564922 32406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:49.578140 32420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.578128 32415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.578123 32418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:49.578194 32406 server_base.cc:1034] running on GCE node
I20260808 05:05:49.578799 32406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:49.579137 32406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:49.580314 32406 hybrid_clock.cc:648] HybridClock initialized: now 1786165549580302 us; error 39 us; skew 500 ppm
Aug 08 05:05:49 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:49.583045 32406 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:05:49.583519 32406 webserver.cc:460] Webserver started at http://127.11.70.254:40875/ using document root <none> and password file <none>
I20260808 05:05:49.583786 32406 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:49.583871 32406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:49.585338 32406 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:49.586086 32432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.586292 32406 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:49.586407 32406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "810c351c43fc419aaf71fd6b103296e2"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "69779cb56568e53a05e4cee542463acc"
server_key_iv: "73a6e3d2d58a7d102511c9ac0e6757fb"
server_key_version: "encryptionkey@0"
I20260808 05:05:49.586866 32406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:49.598580 32406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:49.600739 32406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:49.600904 32406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:49.605417 32406 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:40099
I20260808 05:05:49.605451 32509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:40099 every 8 connection(s)
I20260808 05:05:49.605876 32406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:05:49.607703 32510 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:05:49.608307 32510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Bootstrap starting.
I20260808 05:05:49.614822 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 32406
I20260808 05:05:49.615170 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:38089
--local_ip_for_outbound_sockets=127.11.70.193
--tserver_master_addrs=127.11.70.254:40099
--webserver_port=44849
--webserver_interface=127.11.70.193
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:05:49.618148 32510 log.cc:824] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:49.620313 32510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:05:49.620645 32510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Bootstrap complete.
I20260808 05:05:49.623257 32510 raft_consensus.cc:348] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:49.623507 32510 raft_consensus.cc:729] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810c351c43fc419aaf71fd6b103296e2, State: Initialized, Role: FOLLOWER
I20260808 05:05:49.623683 32510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:49.623749 32510 raft_consensus.cc:388] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:05:49.623817 32510 raft_consensus.cc:482] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:05:49.623862 32510 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:05:49.624899 32510 raft_consensus.cc:504] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:49.624989 32510 leader_election.cc:302] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 810c351c43fc419aaf71fd6b103296e2; no voters:
I20260808 05:05:49.625196 32510 leader_election.cc:288] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:05:49.625234 32514 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:05:49.625347 32514 raft_consensus.cc:686] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 2 LEADER]: Becoming Leader. State: Replica: 810c351c43fc419aaf71fd6b103296e2, State: Running, Role: LEADER
I20260808 05:05:49.625487 32510 sys_catalog.cc:564] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:05:49.625530 32514 consensus_queue.cc:237] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:49.625932 32515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "810c351c43fc419aaf71fd6b103296e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } } }
I20260808 05:05:49.625972 32519 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 810c351c43fc419aaf71fd6b103296e2. Latest consensus state: current_term: 2 leader_uuid: "810c351c43fc419aaf71fd6b103296e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } } }
I20260808 05:05:49.626034 32515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:49.626065 32519 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:49.626372 32530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:05:49.627315 32530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:05:49.627419 32530 catalog_manager.cc:1259] Loaded cluster ID: d82bad470f2e46b99671e835f3e55169
I20260808 05:05:49.627444 32530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:05:49.627673 32530 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 05:05:49.630692 32530 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 05:05:49.632488 32530 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:05:49.632718 32530 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Loaded TSK: 0
I20260808 05:05:49.632941 32530 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:05:49.726905 32512 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:49.727146 32512 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:49.727185 32512 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:49.728345 32512 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:49.728412 32512 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:49.728456 32512 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:05:49.729904 32512 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:38089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=44849
--tserver_master_addrs=127.11.70.254:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32512
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:49.730178 32512 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:49.730412 32512 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:49.735739 32555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.735890 32551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.735760 32559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:49.736209 32512 server_base.cc:1034] running on GCE node
I20260808 05:05:49.736438 32512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:49.736689 32512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:49.737880 32512 hybrid_clock.cc:648] HybridClock initialized: now 1786165549737867 us; error 33 us; skew 500 ppm
Aug 08 05:05:49 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:49.740798 32512 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:05:49.741389 32512 webserver.cc:460] Webserver started at http://127.11.70.193:44849/ using document root <none> and password file <none>
I20260808 05:05:49.741658 32512 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:49.741750 32512 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:49.743625 32512 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:49.744488 32569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.744699 32512 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:49.744809 32512 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "b13e18e878a74e55b03e5d67a3f2ea3e"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "1919f88f3102e4b7a3df929c5b48301a"
server_key_iv: "3c1c0c703a12ce17a49f572cbb56458e"
server_key_version: "encryptionkey@0"
I20260808 05:05:49.745257 32512 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:49.760634 32512 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:49.763356 32512 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:49.763523 32512 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:49.763803 32512 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:49.764349 32578 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:05:49.765820 32512 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:05:49.765889 32512 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 05:05:49.765929 32512 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:05:49.766911 32512 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:05:49.766964 32512 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:49.767040 32578 tablet_bootstrap.cc:492] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Bootstrap starting.
I20260808 05:05:49.775275 32512 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:38089
I20260808 05:05:49.775398 32742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:38089 every 8 connection(s)
I20260808 05:05:49.775938 32512 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:05:49.779336 32578 log.cc:824] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:49.782094 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 32512
I20260808 05:05:49.782198 32578 tablet_bootstrap.cc:492] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:05:49.782414 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:43303
--local_ip_for_outbound_sockets=127.11.70.194
--tserver_master_addrs=127.11.70.254:40099
--webserver_port=33927
--webserver_interface=127.11.70.194
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:05:49.782557 32578 tablet_bootstrap.cc:492] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Bootstrap complete.
I20260808 05:05:49.783849 32578 ts_tablet_manager.cc:1397] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.012s
I20260808 05:05:49.785392 32578 raft_consensus.cc:348] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.785670 32578 raft_consensus.cc:729] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13e18e878a74e55b03e5d67a3f2ea3e, State: Initialized, Role: FOLLOWER
I20260808 05:05:49.785838 32578 consensus_queue.cc:260] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:49.786182 32578 ts_tablet_manager.cc:1428] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
Aug 08 05:05:49 dist-test-slave-7kzw krb5kdc[31607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:49.791702 32749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.776733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:52917)
0808 05:05:49.776948 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.777008 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.777640 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.779160 (+ 1520us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.779164 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.779596 (+ 432us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:49.779887 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.779895 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.781607 (+ 1712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.781609 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.782939 (+ 1330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.782943 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.783981 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.783983 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.784147 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.784807 (+ 660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:49.784828 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:49.786842 (+ 2014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:49.789433 (+ 2591us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:49.789441 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:49.789444 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:49.789771 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:49.790137 (+ 366us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:49.790138 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:49.790139 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:49.790356 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:49.790908 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:49.790916 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:49.791097 (+ 181us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.791233 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.791440 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":121,"threads_started":1}
I20260808 05:05:49.791703 32750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.776916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:52917 (local address 127.11.70.254:40099)
0808 05:05:49.778636 (+ 1720us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.778647 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.778692 (+ 45us) server_negotiation.cc:407] Connection header received
0808 05:05:49.778857 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.778865 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.778932 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.779089 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:49.780017 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.781452 (+ 1435us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.783074 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.783681 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.783836 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.786967 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:49.786971 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:49.786972 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:49.786988 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:49.789335 (+ 2347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.789891 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.789895 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.789895 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.790042 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.790452 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.790453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.790454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.790809 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:49.790916 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.791327 (+ 411us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.791480 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1649,"thread_start_us":83,"threads_started":1}
I20260808 05:05:49.793164 32743 heartbeater.cc:347] Connected to a master server at 127.11.70.254:40099
I20260808 05:05:49.793270 32743 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:49.793485 32743 heartbeater.cc:511] Master 127.11.70.254:40099 requested a full tablet report, sending...
I20260808 05:05:49.794389 32458 ts_manager.cc:194] Registered new tserver with Master: b13e18e878a74e55b03e5d67a3f2ea3e (127.11.70.193:38089)
I20260808 05:05:49.795876 32458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:52917
I20260808 05:05:49.796885 32743 heartbeater.cc:503] Master 127.11.70.254:40099 was elected leader, sending a full tablet report...
I20260808 05:05:49.802268 32756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.796340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:38089 (local address 127.0.0.1:49840)
0808 05:05:49.796905 (+ 565us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.796949 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.797022 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.797581 (+ 559us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.797586 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.797589 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:49.797683 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.797685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.799094 (+ 1409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.799095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.800976 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.800980 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.801963 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.801964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.802058 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.802071 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.802133 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.802184 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":123,"threads_started":1}
I20260808 05:05:49.802618 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.796703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49840 (local address 127.11.70.193:38089)
0808 05:05:49.797163 (+ 460us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.797167 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.797177 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:05:49.797392 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.797395 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.797412 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.797497 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:49.797826 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.798996 (+ 1170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.801078 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.801805 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.801874 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.801927 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.802505 (+ 578us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.802549 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":423,"thread_start_us":97,"threads_started":1}
I20260808 05:05:49.803118 32639 tablet_service.cc:1514] Processing DeleteTablet for tablet e26909f047b54123894389300b18849f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:05:49 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:49840
I20260808 05:05:49.803746 32758 tablet_replica.cc:330] stopping tablet replica
I20260808 05:05:49.803874 32758 raft_consensus.cc:2229] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:05:49.803952 32758 raft_consensus.cc:2258] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:05:49.804358 32758 ts_tablet_manager.cc:1905] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:05:49.806700 32758 ts_tablet_manager.cc:1918] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:05:49.806787 32758 log.cc:1196] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/e26909f047b54123894389300b18849f
I20260808 05:05:49.807127 32758 ts_tablet_manager.cc:1939] T e26909f047b54123894389300b18849f P b13e18e878a74e55b03e5d67a3f2ea3e: Deleting consensus metadata
I20260808 05:05:49.807725 32436 catalog_manager.cc:4841] TS b13e18e878a74e55b03e5d67a3f2ea3e (127.11.70.193:38089): tablet e26909f047b54123894389300b18849f (table test-table [id=f37d6df1a4c7481f80e2d11b67d209ee]) successfully deleted
W20260808 05:05:49.875456 32752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:49.875698 32752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:49.875741 32752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:49.877539 32752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:49.877605 32752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:49.877650 32752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:05:49.879277 32752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:43303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=33927
--tserver_master_addrs=127.11.70.254:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:49.879547 32752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:49.879803 32752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:49.885134 32767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.885113 32765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:49.885104 32763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:49.885463 32752 server_base.cc:1034] running on GCE node
I20260808 05:05:49.885674 32752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:49.885933 32752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:49.887079 32752 hybrid_clock.cc:648] HybridClock initialized: now 1786165549887067 us; error 32 us; skew 500 ppm
Aug 08 05:05:49 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:49.889796 32752 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:05:49.890242 32752 webserver.cc:460] Webserver started at http://127.11.70.194:33927/ using document root <none> and password file <none>
I20260808 05:05:49.890451 32752 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:49.890580 32752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:49.891938 32752 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:49.892644 307 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.892889 32752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:49.892958 32752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "e5d5e411f9fb436b80072ab009cece23"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "f4ea3d14bbea9e4bad43c8cc202cad5f"
server_key_iv: "bdb726ee344072dbbbb9a31e13d0491c"
server_key_version: "encryptionkey@0"
I20260808 05:05:49.893267 32752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:49.913875 32752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:49.916210 32752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:49.916357 32752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:49.916550 32752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:49.916831 32752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:49.916865 32752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.916889 32752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:49.916903 32752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:49.923281 32752 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:43303
I20260808 05:05:49.923355 461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:43303 every 8 connection(s)
I20260808 05:05:49.923750 32752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:05:49 dist-test-slave-7kzw krb5kdc[31607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165549, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:49.932796 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 32752
I20260808 05:05:49.933086 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:38331
--local_ip_for_outbound_sockets=127.11.70.195
--tserver_master_addrs=127.11.70.254:40099
--webserver_port=44565
--webserver_interface=127.11.70.195
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:05:49.934132 32750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.924589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:40835 (local address 127.11.70.254:40099)
0808 05:05:49.924657 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:49.924659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:49.924922 (+ 263us) server_negotiation.cc:407] Connection header received
0808 05:05:49.925435 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:49.925436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:49.925449 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:49.925551 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:49.926750 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.927268 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.928306 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.928534 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.928619 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.930820 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:49.930822 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:49.930822 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:49.930830 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:49.932526 (+ 1696us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.933056 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.933058 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.933058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.933123 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:49.933460 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:49.933461 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:49.933461 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:49.933576 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:49.933633 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:49.933988 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 05:05:49.934066 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:05:49.934499 466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:49.924577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:40835)
0808 05:05:49.924740 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:49.924776 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:49.925343 (+ 567us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:49.925651 (+ 308us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:49.925656 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:49.926321 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:49.926631 (+ 310us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.926644 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.927376 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.927377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.928198 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:49.928200 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:49.928627 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:49.928629 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:49.928764 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:49.929264 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:49.929273 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:49.930718 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:49.932616 (+ 1898us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:49.932625 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:49.932628 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:49.932961 (+ 333us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:49.933223 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:49.933223 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:49.933224 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:49.933387 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:49.933655 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:49.933662 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:49.933844 (+ 182us) client_negotiation.cc:769] Sending connection context
0808 05:05:49.933966 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 05:05:49.934171 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":93,"threads_started":1}
I20260808 05:05:49.935133 462 heartbeater.cc:347] Connected to a master server at 127.11.70.254:40099
I20260808 05:05:49.935264 462 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:49.935472 462 heartbeater.cc:511] Master 127.11.70.254:40099 requested a full tablet report, sending...
I20260808 05:05:49.935904 32458 ts_manager.cc:194] Registered new tserver with Master: e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303)
I20260808 05:05:49.936306 32458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:40835
W20260808 05:05:50.017876 468 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:50.018087 468 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:50.018110 468 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:50.019284 468 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:50.019327 468 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:50.019353 468 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:05:50.020794 468 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:38331
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=44565
--tserver_master_addrs=127.11.70.254:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.468
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:50.021044 468 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:50.021343 468 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:50.026552 476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:50.026669 475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:50.026551 478 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:50.026803 468 server_base.cc:1034] running on GCE node
I20260808 05:05:50.027024 468 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:50.027287 468 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:50.028491 468 hybrid_clock.cc:648] HybridClock initialized: now 1786165550028467 us; error 41 us; skew 500 ppm
Aug 08 05:05:50 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165550, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:50.031248 468 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:05:50.031733 468 webserver.cc:460] Webserver started at http://127.11.70.195:44565/ using document root <none> and password file <none>
I20260808 05:05:50.031965 468 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:50.032054 468 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:50.033413 468 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:50.034049 486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.034262 468 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:50.034373 468 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "fba274560e9246f0b69fa3cd4fd518e7"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "1ce1c002d4fdabecfd99ce7090f56bda"
server_key_iv: "373106cfe4e74e7942a1d2cbbd54f7bd"
server_key_version: "encryptionkey@0"
I20260808 05:05:50.034775 468 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:50.048451 468 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:50.050755 468 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:50.050920 468 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:50.051175 468 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:50.051496 468 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:50.051550 468 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.051599 468 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:50.051631 468 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.057731 468 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:38331
I20260808 05:05:50.057771 662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:38331 every 8 connection(s)
I20260808 05:05:50.058135 468 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:05:50.059989 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 468
Aug 08 05:05:50 dist-test-slave-7kzw krb5kdc[31607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165550, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:05:50.068351 669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.060468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38682 (local address 127.11.70.254:40099)
0808 05:05:50.060569 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:50.060571 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:50.060722 (+ 151us) server_negotiation.cc:407] Connection header received
0808 05:05:50.060815 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:50.060816 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:50.060830 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:50.060914 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:50.061682 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.062382 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.063362 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.063663 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.063739 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.065104 (+ 1365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:50.065106 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:50.065106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:50.065112 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:50.066894 (+ 1782us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:50.067370 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:50.067372 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:50.067372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:50.067440 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:50.067702 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:50.067704 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:50.067704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:50.067877 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:50.068085 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:50.068131 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 05:05:50.068235 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":49,"threads_started":1}
I20260808 05:05:50.069279 32750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.058931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:46291 (local address 127.11.70.254:40099)
0808 05:05:50.058978 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:50.058980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:50.059272 (+ 292us) server_negotiation.cc:407] Connection header received
0808 05:05:50.059748 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:50.059749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:50.059761 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:50.059806 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:50.061006 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.061769 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.062980 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.063297 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.063370 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.065772 (+ 2402us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:50.065774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:50.065774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:50.065782 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:50.067553 (+ 1771us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:50.068107 (+ 554us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:50.068108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:50.068108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:50.068170 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:50.068493 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:50.068495 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:50.068495 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:50.068618 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:50.068682 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:50.069134 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 05:05:50.069213 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:05:50.069562 667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.058929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:46291)
0808 05:05:50.059123 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.059172 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:50.059661 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:50.059885 (+ 224us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:50.059890 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:50.060720 (+ 830us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:50.060920 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.060925 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.061861 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.061862 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.062892 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.062895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.063383 (+ 488us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.063384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.063519 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.064121 (+ 602us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:50.064130 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:50.065672 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:50.067690 (+ 2018us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:50.067699 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:50.067701 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:50.068030 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:50.068254 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:50.068255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:50.068255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:50.068395 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:50.068779 (+ 384us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:50.068785 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:50.068969 (+ 184us) client_negotiation.cc:769] Sending connection context
0808 05:05:50.069094 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 05:05:50.069294 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
I20260808 05:05:50.070015 665 heartbeater.cc:347] Connected to a master server at 127.11.70.254:40099
I20260808 05:05:50.070132 665 heartbeater.cc:464] Registering TS with master...
I20260808 05:05:50.070317 665 heartbeater.cc:511] Master 127.11.70.254:40099 requested a full tablet report, sending...
I20260808 05:05:50.070736 32458 ts_manager.cc:194] Registered new tserver with Master: fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331)
I20260808 05:05:50.071115 32458 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:46291
I20260808 05:05:50.080109 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:05:50.083307 32750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.080534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38694 (local address 127.11.70.254:40099)
0808 05:05:50.080603 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:50.080605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:50.080771 (+ 166us) server_negotiation.cc:407] Connection header received
0808 05:05:50.080813 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:50.080813 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:50.080852 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:50.080917 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:05:50.081154 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.081680 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.082607 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.082803 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.082856 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.083022 (+ 166us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:05:50.083122 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:05:50.083185 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:50.083227 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 05:05:50.083243 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:05:50.083608 32458 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:38694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:05:50.085389 32458 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:05:50.087983 32639 tablet_service.cc:1467] Processing CreateTablet for tablet 9c9a9a310adc46d0b0c324deb71e84bf (DEFAULT_TABLE table=test-table [id=bee3529c913a43838542cb3a999ea00a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:05:50.088229 32639 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c9a9a310adc46d0b0c324deb71e84bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:50.089706 32578 tablet_bootstrap.cc:492] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Bootstrap starting.
I20260808 05:05:50.090071 32578 tablet_bootstrap.cc:654] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:50.090801 32578 tablet_bootstrap.cc:492] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: No bootstrap required, opened a new log
I20260808 05:05:50.090854 32578 ts_tablet_manager.cc:1397] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:50.090969 32578 raft_consensus.cc:348] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.091028 32578 raft_consensus.cc:374] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:50.091070 32578 raft_consensus.cc:729] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13e18e878a74e55b03e5d67a3f2ea3e, State: Initialized, Role: FOLLOWER
I20260808 05:05:50.091120 32578 consensus_queue.cc:260] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.091198 32578 ts_tablet_manager.cc:1428] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.091976 672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.087700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:43303 (local address 127.0.0.1:48404)
0808 05:05:50.087884 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.087893 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:50.087928 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:50.088289 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:50.088290 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:50.088293 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:50.088341 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.088342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.089457 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.089458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.090763 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.090766 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.091716 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.091717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.091790 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.091794 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:05:50.091855 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 05:05:50.091895 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":70,"threads_started":1}
I20260808 05:05:50.092026 674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.087925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48404 (local address 127.11.70.194:43303)
0808 05:05:50.088090 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:50.088096 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:50.088107 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:05:50.088151 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:50.088153 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:50.088170 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:50.088280 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:50.088412 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.089338 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.090846 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.091615 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.091706 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.091780 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:50.091869 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 05:05:50.091921 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":91,"threads_started":1}
I20260808 05:05:50.093046 370 tablet_service.cc:1467] Processing CreateTablet for tablet 9c9a9a310adc46d0b0c324deb71e84bf (DEFAULT_TABLE table=test-table [id=bee3529c913a43838542cb3a999ea00a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:05:50.093470 370 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c9a9a310adc46d0b0c324deb71e84bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:50.093514 32756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.087683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:38331 (local address 127.0.0.1:45022)
0808 05:05:50.087732 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.087764 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:50.087803 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:50.090000 (+ 2197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:50.090002 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:50.090003 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:50.090037 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.090038 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.091379 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.091380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.092409 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.092413 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.093288 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.093289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.093362 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.093366 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:05:50.093428 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:05:50.093463 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:05:50.093595 673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.087766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45022 (local address 127.11.70.195:38331)
0808 05:05:50.089822 (+ 2056us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:50.089826 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:50.089838 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:05:50.089886 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:50.089888 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:50.089903 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:50.089988 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:50.090107 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.091230 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.092497 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.093194 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.093284 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.093341 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:50.093465 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 05:05:50.093512 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2012,"thread_start_us":123,"threads_started":1}
I20260808 05:05:50.094213 557 tablet_service.cc:1467] Processing CreateTablet for tablet 9c9a9a310adc46d0b0c324deb71e84bf (DEFAULT_TABLE table=test-table [id=bee3529c913a43838542cb3a999ea00a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:05:50.094578 557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c9a9a310adc46d0b0c324deb71e84bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:05:50.096498 676 tablet_bootstrap.cc:492] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: Bootstrap starting.
I20260808 05:05:50.097276 676 tablet_bootstrap.cc:654] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:50.097775 677 tablet_bootstrap.cc:492] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: Bootstrap starting.
I20260808 05:05:50.097855 676 log.cc:824] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:50.098587 677 tablet_bootstrap.cc:654] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:05:50.098779 676 tablet_bootstrap.cc:492] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: No bootstrap required, opened a new log
I20260808 05:05:50.098838 676 ts_tablet_manager.cc:1397] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:05:50.099188 677 log.cc:824] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:50.100037 677 tablet_bootstrap.cc:492] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: No bootstrap required, opened a new log
I20260808 05:05:50.100096 677 ts_tablet_manager.cc:1397] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:05:50.100610 676 raft_consensus.cc:348] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.100776 676 raft_consensus.cc:374] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:50.100827 676 raft_consensus.cc:729] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5d5e411f9fb436b80072ab009cece23, State: Initialized, Role: FOLLOWER
I20260808 05:05:50.100944 676 consensus_queue.cc:260] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.101246 676 ts_tablet_manager.cc:1428] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 05:05:50.101289 462 heartbeater.cc:503] Master 127.11.70.254:40099 was elected leader, sending a full tablet report...
I20260808 05:05:50.102065 677 raft_consensus.cc:348] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.102269 677 raft_consensus.cc:374] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:05:50.102324 677 raft_consensus.cc:729] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fba274560e9246f0b69fa3cd4fd518e7, State: Initialized, Role: FOLLOWER
I20260808 05:05:50.102442 677 consensus_queue.cc:260] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.102731 677 ts_tablet_manager.cc:1428] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 05:05:50.102797 665 heartbeater.cc:503] Master 127.11.70.254:40099 was elected leader, sending a full tablet report...
W20260808 05:05:50.174431 463 tablet.cc:2369] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:05:50.279063 32746 tablet.cc:2369] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:05:50.293984 680 raft_consensus.cc:482] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:05:50.294148 680 raft_consensus.cc:504] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.294626 680 leader_election.cc:288] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331), b13e18e878a74e55b03e5d67a3f2ea3e (127.11.70.193:38089)
I20260808 05:05:50.297767 466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.294842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:38331 (local address 127.11.70.194:44879)
0808 05:05:50.294884 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.294897 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:50.294941 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:50.295159 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:50.295160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:50.295163 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:50.295276 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.295278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.296042 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.296043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.296835 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.296838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.297485 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.297486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.297567 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.297571 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:05:50.297636 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:05:50.297681 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 05:05:50.297793 673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.294915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:44879 (local address 127.11.70.195:38331)
0808 05:05:50.294981 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:50.294984 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:50.294995 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:05:50.295029 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:50.295030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:50.295039 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:50.295139 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:50.295400 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.295932 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.296921 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.297400 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.297459 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.297465 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:50.297677 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 05:05:50.297715 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:05:50.297961 683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.294842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:38089 (local address 127.11.70.194:47949)
0808 05:05:50.295042 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.295051 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:50.295101 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:50.295318 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:50.295319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:50.295321 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:05:50.295405 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.295406 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.296110 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.296112 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.297033 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:50.297036 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.297700 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.297701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:50.297772 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.297776 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:05:50.297834 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:05:50.297873 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":48,"thread_start_us":95,"threads_started":1}
I20260808 05:05:50.298113 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.294947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:47949 (local address 127.11.70.193:38089)
0808 05:05:50.294991 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:50.294993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:50.295111 (+ 118us) server_negotiation.cc:407] Connection header received
0808 05:05:50.295185 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:50.295186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:50.295196 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:50.295256 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:05:50.295473 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.296008 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.297140 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.297614 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.297680 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.297688 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:50.297999 (+ 311us) server_negotiation.cc:299] Negotiation successful
0808 05:05:50.298045 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:05:50.298131 585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9a9a310adc46d0b0c324deb71e84bf" candidate_uuid: "e5d5e411f9fb436b80072ab009cece23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fba274560e9246f0b69fa3cd4fd518e7" is_pre_election: true
I20260808 05:05:50.298328 585 raft_consensus.cc:2454] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5d5e411f9fb436b80072ab009cece23 in term 0.
I20260808 05:05:50.298509 32667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9a9a310adc46d0b0c324deb71e84bf" candidate_uuid: "e5d5e411f9fb436b80072ab009cece23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" is_pre_election: true
I20260808 05:05:50.298593 313 leader_election.cc:302] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5d5e411f9fb436b80072ab009cece23, fba274560e9246f0b69fa3cd4fd518e7; no voters:
I20260808 05:05:50.298681 32667 raft_consensus.cc:2454] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e5d5e411f9fb436b80072ab009cece23 in term 0.
I20260808 05:05:50.298712 680 raft_consensus.cc:2781] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:05:50.298808 680 raft_consensus.cc:482] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:05:50.298870 680 raft_consensus.cc:3037] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:50.299615 680 raft_consensus.cc:504] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.299778 680 leader_election.cc:288] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [CANDIDATE]: Term 1 election: Requested vote from peers fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331), b13e18e878a74e55b03e5d67a3f2ea3e (127.11.70.193:38089)
I20260808 05:05:50.299947 32667 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9a9a310adc46d0b0c324deb71e84bf" candidate_uuid: "e5d5e411f9fb436b80072ab009cece23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e"
I20260808 05:05:50.299976 585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c9a9a310adc46d0b0c324deb71e84bf" candidate_uuid: "e5d5e411f9fb436b80072ab009cece23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fba274560e9246f0b69fa3cd4fd518e7"
I20260808 05:05:50.300037 32667 raft_consensus.cc:3037] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:50.300045 585 raft_consensus.cc:3037] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:05:50.300928 585 raft_consensus.cc:2454] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d5e411f9fb436b80072ab009cece23 in term 1.
I20260808 05:05:50.300928 32667 raft_consensus.cc:2454] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e5d5e411f9fb436b80072ab009cece23 in term 1.
I20260808 05:05:50.301105 313 leader_election.cc:302] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e5d5e411f9fb436b80072ab009cece23, fba274560e9246f0b69fa3cd4fd518e7; no voters:
I20260808 05:05:50.301206 680 raft_consensus.cc:2781] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:05:50.301342 680 raft_consensus.cc:686] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 1 LEADER]: Becoming Leader. State: Replica: e5d5e411f9fb436b80072ab009cece23, State: Running, Role: LEADER
I20260808 05:05:50.301417 680 consensus_queue.cc:237] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.302266 32458 catalog_manager.cc:5495] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 reported cstate change: term changed from 0 to 1, leader changed from <none> to e5d5e411f9fb436b80072ab009cece23 (127.11.70.194). New cstate: current_term: 1 leader_uuid: "e5d5e411f9fb436b80072ab009cece23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } health_report { overall_health: UNKNOWN } } }
W20260808 05:05:50.308706 666 tablet.cc:2369] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:05:50.322546 674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.320309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48410 (local address 127.11.70.194:43303)
0808 05:05:50.320370 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:50.320372 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:50.320380 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:05:50.320427 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:50.320428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:50.320445 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:50.320495 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:05:50.320591 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.321038 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.321710 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:50.321887 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:50.321939 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:50.322123 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:05:50.322233 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:05:50.322329 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:50.322397 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 05:05:50.322418 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:05:50.324261 585 raft_consensus.cc:1261] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [term 1 FOLLOWER]: Refusing update from remote peer e5d5e411f9fb436b80072ab009cece23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:05:50.324281 32667 raft_consensus.cc:1261] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Refusing update from remote peer e5d5e411f9fb436b80072ab009cece23: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:05:50.324611 684 consensus_queue.cc:1035] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:05:50.324764 680 consensus_queue.cc:1035] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:05:50.326654 691 mvcc.cc:205] Tried to move back new op lower bound from 7316134094125608960 to 7316134094035173376. Current Snapshot: MvccSnapshot[applied={T|T < 7316134094125608960}]
I20260808 05:05:50.327984 693 mvcc.cc:205] Tried to move back new op lower bound from 7316134094125608960 to 7316134094035173376. Current Snapshot: MvccSnapshot[applied={T|T < 7316134094125608960}]
I20260808 05:05:50.329005 32458 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:38694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:05:50.329120 32458 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:38694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:05:50.329936 32458 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Sending DeleteTablet for 3 replicas of tablet 9c9a9a310adc46d0b0c324deb71e84bf
I20260808 05:05:50.330253 370 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c9a9a310adc46d0b0c324deb71e84bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:05:50 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:48404
I20260808 05:05:50.330292 557 tablet_service.cc:1514] Processing DeleteTablet for tablet 9c9a9a310adc46d0b0c324deb71e84bf with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:05:50 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:45022
I20260808 05:05:50.330322 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 32512
I20260808 05:05:50.330510 703 tablet_replica.cc:330] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: stopping tablet replica
I20260808 05:05:50.330658 703 raft_consensus.cc:2229] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:05:50.330869 703 raft_consensus.cc:2258] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:05:50.331259 703 ts_tablet_manager.cc:1905] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:05:50.333000 703 ts_tablet_manager.cc:1918] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:05:50.333089 703 log.cc:1196] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/9c9a9a310adc46d0b0c324deb71e84bf
I20260808 05:05:50.333447 703 ts_tablet_manager.cc:1939] T 9c9a9a310adc46d0b0c324deb71e84bf P e5d5e411f9fb436b80072ab009cece23: Deleting consensus metadata
I20260808 05:05:50.333894 32435 catalog_manager.cc:4841] TS e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303): tablet 9c9a9a310adc46d0b0c324deb71e84bf (table test-table [id=bee3529c913a43838542cb3a999ea00a]) successfully deleted
I20260808 05:05:50.337530 702 tablet_replica.cc:330] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: stopping tablet replica
I20260808 05:05:50.337735 702 raft_consensus.cc:2229] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:05:50.337918 702 raft_consensus.cc:2258] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:05:50.342937 702 ts_tablet_manager.cc:1905] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 05:05:50.344370 32436 connection.cc:535] client connection to 127.11.70.193:38089 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260808 05:05:50.344475 32436 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 05:05:50.344736 702 ts_tablet_manager.cc:1918] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:05:50.344883 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 32752
I20260808 05:05:50.344915 702 log.cc:1196] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/9c9a9a310adc46d0b0c324deb71e84bf
I20260808 05:05:50.344990 32756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.344817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:38089 (local address 127.0.0.1:49854)
0808 05:05:50.344894 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.344949 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:38089: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 05:05:50.345263 702 ts_tablet_manager.cc:1939] T 9c9a9a310adc46d0b0c324deb71e84bf P fba274560e9246f0b69fa3cd4fd518e7: Deleting consensus metadata
W20260808 05:05:50.345103 32436 catalog_manager.cc:4584] TS b13e18e878a74e55b03e5d67a3f2ea3e (127.11.70.193:38089): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9c9a9a310adc46d0b0c324deb71e84bf: Network error: Client connection negotiation failed: client connection to 127.11.70.193:38089: connect: Connection refused (error 111)
I20260808 05:05:50.345670 32438 catalog_manager.cc:4841] TS fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331): tablet 9c9a9a310adc46d0b0c324deb71e84bf (table test-table [id=bee3529c913a43838542cb3a999ea00a]) successfully deleted
I20260808 05:05:50.360529 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 468
I20260808 05:05:50.371012 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 32406
I20260808 05:05:50.381642 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:40099
--webserver_interface=127.11.70.254
--webserver_port=40875
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:40099
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:50.470417 705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:50.470634 705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:50.470656 705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:50.471818 705 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:05:50.471861 705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:50.471876 705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:50.471889 705 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:05:50.471901 705 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:05:50.473402 705 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:40099
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:40099
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=40875
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:50.473647 705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:50.473934 705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:50.479434 716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:50.479445 717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:50.479434 719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:50.479857 705 server_base.cc:1034] running on GCE node
I20260808 05:05:50.480198 705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:50.480521 705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:50.481683 705 hybrid_clock.cc:648] HybridClock initialized: now 1786165550481660 us; error 40 us; skew 500 ppm
Aug 08 05:05:50 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165550, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:50.484413 705 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:05:50.484889 705 webserver.cc:460] Webserver started at http://127.11.70.254:40875/ using document root <none> and password file <none>
I20260808 05:05:50.485132 705 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:50.485208 705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:50.486611 705 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:50.487346 729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.487645 705 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:50.487761 705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "810c351c43fc419aaf71fd6b103296e2"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "69779cb56568e53a05e4cee542463acc"
server_key_iv: "73a6e3d2d58a7d102511c9ac0e6757fb"
server_key_version: "encryptionkey@0"
I20260808 05:05:50.488096 705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:50.499543 705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:50.501688 705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:50.501883 705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:50.506146 705 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:40099
I20260808 05:05:50.506186 797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:40099 every 8 connection(s)
I20260808 05:05:50.506631 705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:05:50.507349 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 705
I20260808 05:05:50.507700 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:38089
--local_ip_for_outbound_sockets=127.11.70.193
--tserver_master_addrs=127.11.70.254:40099
--webserver_port=44849
--webserver_interface=127.11.70.193
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:05:50.509132 798 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:05:50.510054 798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Bootstrap starting.
I20260808 05:05:50.519327 798 log.cc:824] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:50.521945 798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:05:50.522258 798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2: Bootstrap complete.
I20260808 05:05:50.524766 798 raft_consensus.cc:348] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:50.524986 798 raft_consensus.cc:729] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810c351c43fc419aaf71fd6b103296e2, State: Initialized, Role: FOLLOWER
I20260808 05:05:50.525153 798 consensus_queue.cc:260] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:50.525229 798 raft_consensus.cc:388] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:05:50.525281 798 raft_consensus.cc:482] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:05:50.525331 798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 2 FOLLOWER]: Advancing to term 3
I20260808 05:05:50.526351 798 raft_consensus.cc:504] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:50.526438 798 leader_election.cc:302] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 810c351c43fc419aaf71fd6b103296e2; no voters:
I20260808 05:05:50.526674 798 leader_election.cc:288] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 05:05:50.526712 802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 05:05:50.526820 802 raft_consensus.cc:686] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [term 3 LEADER]: Becoming Leader. State: Replica: 810c351c43fc419aaf71fd6b103296e2, State: Running, Role: LEADER
I20260808 05:05:50.526926 802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } }
I20260808 05:05:50.526955 798 sys_catalog.cc:564] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:05:50.527230 802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "810c351c43fc419aaf71fd6b103296e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } } }
I20260808 05:05:50.527315 802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:50.527446 802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 810c351c43fc419aaf71fd6b103296e2. Latest consensus state: current_term: 3 leader_uuid: "810c351c43fc419aaf71fd6b103296e2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "810c351c43fc419aaf71fd6b103296e2" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 40099 } } }
I20260808 05:05:50.527567 802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 810c351c43fc419aaf71fd6b103296e2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:05:50.527874 813 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:05:50.528728 813 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:05:50.528868 813 catalog_manager.cc:1259] Loaded cluster ID: d82bad470f2e46b99671e835f3e55169
I20260808 05:05:50.528960 813 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 05:05:50.529428 813 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f7d7296f9ad google::LogMessage::Fail() at ??:0
@ 0x7f7d7297288a google::LogMessage::SendToLog() at ??:0
@ 0x7f7d7296f4de google::LogMessage::Flush() at ??:0
@ 0x7f7d72970a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f7d7a8950f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f7d7a89e8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f7d7483d0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f7d74832954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f7d756966db start_thread at ??:0
@ 0x7f7d7146d61f clone at ??:0
W20260808 05:05:50.623709 800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:50.623903 800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:50.623927 800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:50.625111 800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:50.625157 800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:50.625185 800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:05:50.626773 800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:38089
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=44849
--tserver_master_addrs=127.11.70.254:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:50.627018 800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:50.627349 800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:50.632450 858 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:50.632664 800 server_base.cc:1034] running on GCE node
W20260808 05:05:50.632741 855 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:50.632562 856 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:50.632980 800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:50.633266 800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:50.634443 800 hybrid_clock.cc:648] HybridClock initialized: now 1786165550634410 us; error 49 us; skew 500 ppm
Aug 08 05:05:50 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165550, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:50.637300 800 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:05:50.637794 800 webserver.cc:460] Webserver started at http://127.11.70.193:44849/ using document root <none> and password file <none>
I20260808 05:05:50.638052 800 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:50.638118 800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:50.639539 800 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:50.640287 866 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.640512 800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:50.640604 800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "b13e18e878a74e55b03e5d67a3f2ea3e"
format_stamp: "Formatted at 2026-08-08 05:05:48 on dist-test-slave-7kzw"
server_key: "1919f88f3102e4b7a3df929c5b48301a"
server_key_iv: "3c1c0c703a12ce17a49f572cbb56458e"
server_key_version: "encryptionkey@0"
I20260808 05:05:50.640976 800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:50.658100 800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:50.660629 800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:50.660782 800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:50.661116 800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:50.661639 873 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:05:50.663707 800 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:05:50.663787 800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 05:05:50.663836 800 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:05:50.664511 800 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:05:50.664606 800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 05:05:50.664644 873 tablet_bootstrap.cc:492] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Bootstrap starting.
I20260808 05:05:50.672415 800 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:38089
I20260808 05:05:50.672518 1018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:38089 every 8 connection(s)
I20260808 05:05:50.672861 800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:05:50.674585 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 800
I20260808 05:05:50.674868 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:43303
--local_ip_for_outbound_sockets=127.11.70.194
--tserver_master_addrs=127.11.70.254:40099
--webserver_port=33927
--webserver_interface=127.11.70.194
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:05:50.677079 873 log.cc:824] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:05:50.679970 873 tablet_bootstrap.cc:492] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:05:50.680295 873 tablet_bootstrap.cc:492] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Bootstrap complete.
I20260808 05:05:50.681720 873 ts_tablet_manager.cc:1397] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.007s
I20260808 05:05:50.683234 873 raft_consensus.cc:348] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.683573 873 raft_consensus.cc:729] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b13e18e878a74e55b03e5d67a3f2ea3e, State: Initialized, Role: FOLLOWER
I20260808 05:05:50.683769 873 consensus_queue.cc:260] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:50.684055 873 ts_tablet_manager.cc:1428] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s
W20260808 05:05:50.766551 1024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:50.766808 1024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:50.766853 1024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:50.768085 1024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:50.768155 1024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:50.768201 1024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
W20260808 05:05:50.769690 1023 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:05:50.673609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:56619)
0808 05:05:50.673811 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.673849 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:50.674297 (+ 448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:50.769481 (+ 95184us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":109,"threads_started":1}
W20260808 05:05:50.769979 1019 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:40099 (0 consecutive failures): Network error: Failed to ping master at 127.11.70.254:40099: Client connection negotiation failed: client connection to 127.11.70.254:40099: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 05:05:50.769984 1024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:43303
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=33927
--tserver_master_addrs=127.11.70.254:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:50.770213 1024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:50.770380 1023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.770229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:42145)
0808 05:05:50.770295 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.770346 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 05:05:50.770539 1024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:05:50.770793 1023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.770707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:48075)
0808 05:05:50.770748 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.770774 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 05:05:50.770910 1019 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:05:50.775856 1034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:50.775928 1036 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:50.775879 1038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:50.776298 1024 server_base.cc:1034] running on GCE node
I20260808 05:05:50.776521 1024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:50.776785 1024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:50.777954 1024 hybrid_clock.cc:648] HybridClock initialized: now 1786165550777943 us; error 32 us; skew 500 ppm
Aug 08 05:05:50 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165550, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:50.780603 1024 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:05:50.781056 1024 webserver.cc:460] Webserver started at http://127.11.70.194:33927/ using document root <none> and password file <none>
I20260808 05:05:50.781299 1024 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:50.781376 1024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:50.782838 1024 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:05:50.783473 1049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.783653 1024 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:05:50.783764 1024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "e5d5e411f9fb436b80072ab009cece23"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "f4ea3d14bbea9e4bad43c8cc202cad5f"
server_key_iv: "bdb726ee344072dbbbb9a31e13d0491c"
server_key_version: "encryptionkey@0"
I20260808 05:05:50.784121 1024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:50.800809 1024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:50.802923 1024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:50.803097 1024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:50.803368 1024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:50.803706 1024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:50.803769 1024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.803817 1024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:50.803840 1024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.810050 1024 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:43303
I20260808 05:05:50.810097 1218 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:43303 every 8 connection(s)
I20260808 05:05:50.810454 1024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:05:50.811589 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.811181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:44569)
0808 05:05:50.811354 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.811432 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":88,"threads_started":1}
W20260808 05:05:50.812038 1220 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:40099 (0 consecutive failures): Network error: Failed to ping master at 127.11.70.254:40099: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
I20260808 05:05:50.812351 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.812257 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:53351)
0808 05:05:50.812306 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.812333 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:05:50.812623 1222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.812569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:47407)
0808 05:05:50.812593 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.812610 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260808 05:05:50.812737 1220 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:05:50.815037 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 1024
I20260808 05:05:50.815362 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:38331
--local_ip_for_outbound_sockets=127.11.70.195
--tserver_master_addrs=127.11.70.254:40099
--webserver_port=44565
--webserver_interface=127.11.70.195
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41869
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:05:50.901654 1223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:05:50.901855 1223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:05:50.901878 1223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:05:50.902974 1223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:05:50.903010 1223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:05:50.903035 1223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:05:50.904392 1223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41869
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:38331
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=44565
--tserver_master_addrs=127.11.70.254:40099
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:05:50.904570 1223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:05:50.904742 1223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:05:50.909952 1230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:50.909981 1231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:05:50.909960 1233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:05:50.910292 1223 server_base.cc:1034] running on GCE node
I20260808 05:05:50.910548 1223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:05:50.910754 1223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:05:50.911898 1223 hybrid_clock.cc:648] HybridClock initialized: now 1786165550911887 us; error 32 us; skew 500 ppm
Aug 08 05:05:50 dist-test-slave-7kzw krb5kdc[31607](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165550, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:05:50.914350 1223 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:05:50.914857 1223 webserver.cc:460] Webserver started at http://127.11.70.195:44565/ using document root <none> and password file <none>
I20260808 05:05:50.915055 1223 fs_manager.cc:359] Metadata directory not provided
I20260808 05:05:50.915098 1223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:05:50.916394 1223 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:50.917011 1242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.917207 1223 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:05:50.917284 1223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "fba274560e9246f0b69fa3cd4fd518e7"
format_stamp: "Formatted at 2026-08-08 05:05:49 on dist-test-slave-7kzw"
server_key: "1ce1c002d4fdabecfd99ce7090f56bda"
server_key_iv: "373106cfe4e74e7942a1d2cbbd54f7bd"
server_key_version: "encryptionkey@0"
I20260808 05:05:50.917591 1223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:05:50.936197 1223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:05:50.938657 1223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:05:50.938776 1223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:05:50.938985 1223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:05:50.939313 1223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:05:50.939350 1223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.939373 1223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:05:50.939386 1223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:05:50.945580 1223 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:38331
I20260808 05:05:50.945693 1426 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:38331 every 8 connection(s)
I20260808 05:05:50.946024 1223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:05:50.947209 1430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.946816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:37451)
0808 05:05:50.946987 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.947065 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
W20260808 05:05:50.947695 1427 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:40099 (0 consecutive failures): Network error: Failed to ping master at 127.11.70.254:40099: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
I20260808 05:05:50.948009 1430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.947914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:35921)
0808 05:05:50.947960 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.947989 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:05:50.948339 1430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:50.948259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:50009)
0808 05:05:50.948303 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:50.948324 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 05:05:50.948490 1427 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:05:50.951531 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 1223
I20260808 05:05:51.771569 1436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:51.771266 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:46627)
0808 05:05:51.771448 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:51.771492 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":66,"threads_started":1}
I20260808 05:05:51.813297 1437 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:51.813064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:54243)
0808 05:05:51.813206 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:51.813242 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":66,"threads_started":1}
I20260808 05:05:51.923488 1438 raft_consensus.cc:482] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:05:51.923684 1438 raft_consensus.cc:504] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:51.924047 1438 leader_election.cc:288] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331), e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303)
Aug 08 05:05:51 dist-test-slave-7kzw krb5kdc[31607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165550, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.195@KRBTEST.COM
Aug 08 05:05:51 dist-test-slave-7kzw krb5kdc[31607](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165550, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.194@KRBTEST.COM
I20260808 05:05:51.934902 1440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:51.924332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:39323 (local address 127.11.70.195:38331)
0808 05:05:51.924503 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:51.924515 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:51.924545 (+ 30us) server_negotiation.cc:407] Connection header received
0808 05:05:51.925001 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:51.925003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:51.925057 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:51.925213 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:51.925970 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:51.926954 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:51.927949 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:51.928347 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:51.928471 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:51.930934 (+ 2463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:51.930938 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:51.930938 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:51.930974 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:51.932946 (+ 1972us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:51.933440 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:51.933443 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:51.933443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:51.933578 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:51.933881 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:51.933882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:51.933882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:51.934204 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:51.934309 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:51.934659 (+ 350us) server_negotiation.cc:299] Negotiation successful
0808 05:05:51.934799 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":56,"threads_started":1}
I20260808 05:05:51.934916 1441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:51.924377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:50769 (local address 127.11.70.194:43303)
0808 05:05:51.924540 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 05:05:51.924549 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:05:51.924577 (+ 28us) server_negotiation.cc:407] Connection header received
0808 05:05:51.925017 (+ 440us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:05:51.925019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:05:51.925057 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:05:51.925213 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:05:51.926006 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:51.926964 (+ 958us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:51.927953 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:05:51.928347 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:05:51.928482 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:51.931271 (+ 2789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:05:51.931275 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:05:51.931276 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:05:51.931288 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:05:51.933143 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:51.933537 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:51.933539 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:51.933539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:51.933645 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:05:51.933881 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:05:51.933882 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:05:51.933882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:05:51.934204 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:05:51.934353 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 05:05:51.934659 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 05:05:51.934799 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":54,"threads_started":1}
I20260808 05:05:51.934903 1439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:51.924248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:43303 (local address 127.11.70.193:50769)
0808 05:05:51.924393 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:51.924403 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:51.924458 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:51.925244 (+ 786us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:51.925247 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:51.925638 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:51.925845 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:51.925852 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:51.927085 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:51.927086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:51.927852 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:51.927855 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:51.928446 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:51.928448 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:51.928575 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:51.929221 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:51.929225 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:51.931159 (+ 1934us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:51.933220 (+ 2061us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:51.933222 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:51.933222 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:51.933456 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:51.933725 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:51.933726 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:51.933726 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:51.933803 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:51.934287 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:51.934294 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:51.934447 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 05:05:51.934572 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 05:05:51.934786 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"mutex_wait_us":104,"thread_start_us":73,"threads_started":1}
I20260808 05:05:51.934963 1436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:51.924192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:38331 (local address 127.11.70.193:39323)
0808 05:05:51.924255 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:51.924268 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:05:51.924343 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:05:51.925257 (+ 914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:05:51.925258 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:05:51.925639 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:05:51.925842 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:51.925850 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:51.927047 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:51.927049 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:51.927853 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:05:51.927855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:05:51.928468 (+ 613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:05:51.928470 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:05:51.928588 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:05:51.929166 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:05:51.929174 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:05:51.930814 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:05:51.933037 (+ 2223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:51.933044 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:51.933046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:51.933357 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:51.933652 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:05:51.933652 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:05:51.933652 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:05:51.933804 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:05:51.934287 (+ 483us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:05:51.934294 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:05:51.934447 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 05:05:51.934572 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 05:05:51.934846 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":136}
W20260808 05:05:51.935766 868 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
W20260808 05:05:51.935931 870 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
I20260808 05:05:51.936017 870 leader_election.cc:302] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b13e18e878a74e55b03e5d67a3f2ea3e; no voters: e5d5e411f9fb436b80072ab009cece23, fba274560e9246f0b69fa3cd4fd518e7
I20260808 05:05:51.936161 1438 raft_consensus.cc:2726] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:05:51.948968 1443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:51.948787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:41085)
0808 05:05:51.948894 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:51.948935 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":64,"threads_started":1}
I20260808 05:05:52.772343 1444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:52.772085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:46535)
0808 05:05:52.772251 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:52.772291 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":71,"threads_started":1}
I20260808 05:05:52.813957 1445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:52.813761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:52733)
0808 05:05:52.813882 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:52.813919 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":63,"threads_started":1}
I20260808 05:05:52.949604 1446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:52.949398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:55261)
0808 05:05:52.949529 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:52.949564 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":73,"threads_started":1}
I20260808 05:05:53.440481 1447 raft_consensus.cc:482] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:05:53.440615 1447 raft_consensus.cc:504] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:53.440845 1447 leader_election.cc:288] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331), e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303)
W20260808 05:05:53.441341 870 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
W20260808 05:05:53.441421 868 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
I20260808 05:05:53.441550 868 leader_election.cc:302] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b13e18e878a74e55b03e5d67a3f2ea3e; no voters: e5d5e411f9fb436b80072ab009cece23, fba274560e9246f0b69fa3cd4fd518e7
I20260808 05:05:53.441642 1447 raft_consensus.cc:2726] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:05:53.773205 1449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:53.772968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:57145)
0808 05:05:53.773105 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:53.773141 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":87,"threads_started":1}
I20260808 05:05:53.814633 1451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:53.814376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:47893)
0808 05:05:53.814552 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:53.814589 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":99,"threads_started":1}
I20260808 05:05:53.950369 1453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:53.950126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:38587)
0808 05:05:53.950286 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:53.950325 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":80,"threads_started":1}
I20260808 05:05:54.773984 1456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:54.773752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:58015)
0808 05:05:54.773888 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:54.773930 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":68,"threads_started":1}
I20260808 05:05:54.815325 1457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:54.815103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:60681)
0808 05:05:54.815243 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:54.815282 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":81,"threads_started":1}
I20260808 05:05:54.951131 1458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:54.950875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:43831)
0808 05:05:54.951033 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:54.951075 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":80,"threads_started":1}
I20260808 05:05:55.774850 1459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:55.774604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:55873)
0808 05:05:55.774756 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:55.774797 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":64,"threads_started":1}
I20260808 05:05:55.816025 1460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:55.815803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:34647)
0808 05:05:55.815947 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:55.815981 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":84,"threads_started":1}
I20260808 05:05:55.951856 1461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:55.951592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:57205)
0808 05:05:55.951767 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:55.951807 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":82,"threads_started":1}
I20260808 05:05:56.349426 1462 raft_consensus.cc:482] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:05:56.349531 1462 raft_consensus.cc:504] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:05:56.349737 1462 leader_election.cc:288] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331), e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303)
W20260808 05:05:56.350143 870 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
W20260808 05:05:56.350260 868 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
I20260808 05:05:56.350342 868 leader_election.cc:302] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b13e18e878a74e55b03e5d67a3f2ea3e; no voters: e5d5e411f9fb436b80072ab009cece23, fba274560e9246f0b69fa3cd4fd518e7
I20260808 05:05:56.350430 1462 raft_consensus.cc:2726] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:05:56.775614 1463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:56.775372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:40517)
0808 05:05:56.775514 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:56.775558 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260808 05:05:56.816738 1464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:56.816532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:53505)
0808 05:05:56.816652 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:56.816692 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
I20260808 05:05:56.952662 1466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:56.952372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:57293)
0808 05:05:56.952523 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:56.952613 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":65,"threads_started":1}
I20260808 05:05:57.776393 1467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:57.776100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:60977)
0808 05:05:57.776299 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:57.776340 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":73,"threads_started":1}
I20260808 05:05:57.817442 1469 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:57.817236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:59625)
0808 05:05:57.817371 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:57.817400 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":77,"threads_started":1}
I20260808 05:05:57.953506 1470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:57.953278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:51445)
0808 05:05:57.953423 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:57.953462 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260808 05:05:58.777189 1473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:58.776955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:41495)
0808 05:05:58.777098 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:58.777137 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":68,"threads_started":1}
I20260808 05:05:58.818111 1476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:58.817910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:37995)
0808 05:05:58.818034 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:58.818067 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260808 05:05:58.954164 1477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:58.953955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:39511)
0808 05:05:58.954081 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:58.954115 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":63,"threads_started":1}
I20260808 05:05:59.778108 1478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:59.777872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:32923)
0808 05:05:59.778013 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:59.778054 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260808 05:05:59.818814 1479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:59.818592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:43441)
0808 05:05:59.818722 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:59.818765 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":68,"threads_started":1}
I20260808 05:05:59.954952 1480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:05:59.954695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:60983)
0808 05:05:59.954860 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:05:59.954901 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":69,"threads_started":1}
I20260808 05:06:00.051278 1481 raft_consensus.cc:482] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:06:00.051404 1481 raft_consensus.cc:504] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:06:00.051597 1481 leader_election.cc:288] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331), e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303)
W20260808 05:06:00.051965 870 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
W20260808 05:06:00.052043 868 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
I20260808 05:06:00.052080 868 leader_election.cc:302] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b13e18e878a74e55b03e5d67a3f2ea3e; no voters: e5d5e411f9fb436b80072ab009cece23, fba274560e9246f0b69fa3cd4fd518e7
I20260808 05:06:00.052160 1481 raft_consensus.cc:2726] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:06:00.778861 1483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:00.778617 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:43201)
0808 05:06:00.778768 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:00.778808 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":76,"threads_started":1}
I20260808 05:06:00.819523 1484 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:00.819295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:60653)
0808 05:06:00.819432 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:00.819471 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":65,"threads_started":1}
I20260808 05:06:00.955716 1485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:00.955454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:37361)
0808 05:06:00.955621 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:00.955663 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":70,"threads_started":1}
I20260808 05:06:01.779579 1487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:01.779354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:55181)
0808 05:06:01.779486 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:01.779526 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":72,"threads_started":1}
I20260808 05:06:01.820353 1489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:01.820120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:38125)
0808 05:06:01.820266 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:01.820306 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":72,"threads_started":1}
I20260808 05:06:01.956553 1490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:01.956306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:37739)
0808 05:06:01.956455 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:01.956500 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260808 05:06:02.645047 1491 raft_consensus.cc:482] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:06:02.645166 1491 raft_consensus.cc:504] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fba274560e9246f0b69fa3cd4fd518e7" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 38331 } } peers { permanent_uuid: "e5d5e411f9fb436b80072ab009cece23" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 43303 } } peers { permanent_uuid: "b13e18e878a74e55b03e5d67a3f2ea3e" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 38089 } }
I20260808 05:06:02.645378 1491 leader_election.cc:288] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331), e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303)
W20260808 05:06:02.645773 870 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer fba274560e9246f0b69fa3cd4fd518e7 (127.11.70.195:38331): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
W20260808 05:06:02.645881 868 leader_election.cc:341] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e5d5e411f9fb436b80072ab009cece23 (127.11.70.194:43303): Not found: Tablet not found: 9c9a9a310adc46d0b0c324deb71e84bf
I20260808 05:06:02.645932 868 leader_election.cc:302] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b13e18e878a74e55b03e5d67a3f2ea3e; no voters: e5d5e411f9fb436b80072ab009cece23, fba274560e9246f0b69fa3cd4fd518e7
I20260808 05:06:02.646014 1491 raft_consensus.cc:2726] T 9c9a9a310adc46d0b0c324deb71e84bf P b13e18e878a74e55b03e5d67a3f2ea3e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:06:02.780269 1492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:02.780042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:43283)
0808 05:06:02.780180 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:02.780215 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260808 05:06:02.821190 1493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:02.820894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:36653)
0808 05:06:02.821040 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:02.821084 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260808 05:06:02.957329 1494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:02.957102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:36443)
0808 05:06:02.957240 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:02.957279 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":68,"threads_started":1}
I20260808 05:06:03.781078 1495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:03.780837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:45349)
0808 05:06:03.780986 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:03.781026 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260808 05:06:03.821954 1497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:03.821694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:45753)
0808 05:06:03.821859 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:03.821905 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":71,"threads_started":1}
I20260808 05:06:03.958139 1498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:03.957872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:38095)
0808 05:06:03.958033 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:03.958074 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":86,"threads_started":1}
I20260808 05:06:04.781816 1499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:04.781591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:57967)
0808 05:06:04.781726 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:04.781763 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
I20260808 05:06:04.822832 1500 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:04.822542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:60799)
0808 05:06:04.822732 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:04.822785 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":115,"threads_started":1}
I20260808 05:06:04.959131 1501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:04.958795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:60263)
0808 05:06:04.959017 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:04.959073 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":91,"threads_started":1}
I20260808 05:06:05.782768 1503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:05.782544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.193:54491)
0808 05:06:05.782674 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:05.782706 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260808 05:06:05.823861 1504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:05.823556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.194:55769)
0808 05:06:05.823740 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:05.823789 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":88,"threads_started":1}
I20260808 05:06:05.952220 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 800
I20260808 05:06:05.959946 1506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:05.959722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:40099 (local address 127.11.70.195:50315)
0808 05:06:05.959863 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:05.959899 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:40099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260808 05:06:05.961717 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 1024
I20260808 05:06:05.972700 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 1223
2026-08-08T05:06:05Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18769 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:06:06 dist-test-slave-7kzw krb5kdc[1509](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:06:06 dist-test-slave-7kzw krb5kdc[1509](info): set up 2 sockets
Aug 08 05:06:06 dist-test-slave-7kzw krb5kdc[1509](info): commencing operation
krb5kdc: starting...
W20260808 05:06:07.289546 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.293s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:06:07 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:06:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:06:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:06:07.417578 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34519
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:34519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:06:07.501345 1530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:07.501595 1530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:07.501643 1530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:07.502808 1530 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 05:06:07.502878 1530 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 05:06:07.502900 1530 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 05:06:07.502919 1530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:06:07.502952 1530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:07.502988 1530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:07.503017 1530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:06:07.503041 1530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:06:07.504528 1530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:34519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:07.504822 1530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:07.505057 1530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:06:07.510720 1530 server_base.cc:1034] running on GCE node
W20260808 05:06:07.510706 1538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:07.510700 1543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:07.510670 1540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:07.511222 1530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:07.511562 1530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:07.512712 1530 hybrid_clock.cc:648] HybridClock initialized: now 1786165567512688 us; error 36 us; skew 500 ppm
Aug 08 05:06:07 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:07.515321 1530 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:06:07.515844 1530 webserver.cc:460] Webserver started at http://127.11.70.254:39659/ using document root <none> and password file <none>
I20260808 05:06:07.516130 1530 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:07.516178 1530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:07.516273 1530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:06:07.517315 1530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "2fd827cb3db14ff883eca90c002df52a"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "197690460d3b570cff8f2458a51d73ae"
server_key_iv: "e75deae9fe8b3c87b12670b9d2b1b69c"
server_key_version: "encryptionkey@0"
I20260808 05:06:07.517642 1530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "2fd827cb3db14ff883eca90c002df52a"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "197690460d3b570cff8f2458a51d73ae"
server_key_iv: "e75deae9fe8b3c87b12670b9d2b1b69c"
server_key_version: "encryptionkey@0"
I20260808 05:06:07.519013 1530 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:06:07.519713 1554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:07.519898 1530 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:06:07.519977 1530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "2fd827cb3db14ff883eca90c002df52a"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "197690460d3b570cff8f2458a51d73ae"
server_key_iv: "e75deae9fe8b3c87b12670b9d2b1b69c"
server_key_version: "encryptionkey@0"
I20260808 05:06:07.520031 1530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:07.555230 1530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:07.557770 1530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:07.557890 1530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:07.562078 1530 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:34519
I20260808 05:06:07.562163 1631 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:34519 every 8 connection(s)
I20260808 05:06:07.562559 1530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:06:07.563356 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 1530
I20260808 05:06:07.563455 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:06:07.563715 1633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:06:07.563732 11547 external_mini_cluster.cc:1428] Setting key 335cba6c27117d26d5a50e728f375984
I20260808 05:06:07.567332 1633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Bootstrap starting.
I20260808 05:06:07.568069 1633 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Neither blocks nor log segments found. Creating new log.
I20260808 05:06:07.568379 1633 log.cc:824] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:07.569146 1633 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: No bootstrap required, opened a new log
Aug 08 05:06:07 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165567, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:06:07.571319 1633 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:07.571511 1633 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:06:07.571574 1633 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fd827cb3db14ff883eca90c002df52a, State: Initialized, Role: FOLLOWER
I20260808 05:06:07.571708 1633 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:07.571772 1633 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:06:07.571795 1633 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:06:07.571895 1633 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:06:07.572706 1633 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:07.572830 1633 leader_election.cc:302] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fd827cb3db14ff883eca90c002df52a; no voters:
I20260808 05:06:07.573014 1633 leader_election.cc:288] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:06:07.573068 1641 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:06:07.573273 1641 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 1 LEADER]: Becoming Leader. State: Replica: 2fd827cb3db14ff883eca90c002df52a, State: Running, Role: LEADER
I20260808 05:06:07.573360 1633 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:06:07.573426 1641 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:07.573868 1641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fd827cb3db14ff883eca90c002df52a. Latest consensus state: current_term: 1 leader_uuid: "2fd827cb3db14ff883eca90c002df52a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } } }
I20260808 05:06:07.573879 1643 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fd827cb3db14ff883eca90c002df52a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } } }
I20260808 05:06:07.574054 1643 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: This master's current role is: LEADER
I20260808 05:06:07.574301 1641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: This master's current role is: LEADER
I20260808 05:06:07.574501 1651 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:06:07.575819 1651 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:06:07.575824 1639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:07.564368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47428 (local address 127.11.70.254:34519)
0808 05:06:07.564605 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:07.564616 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:07.564665 (+ 49us) server_negotiation.cc:407] Connection header received
0808 05:06:07.565440 (+ 775us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:07.565450 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:07.565518 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:07.565676 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:07.566360 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.567839 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.568770 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.569218 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.569366 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:07.571914 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:07.571918 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:07.571919 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:07.571930 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:07.574029 (+ 2099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:07.574491 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:07.574495 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:07.574496 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:07.574625 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:07.574883 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:07.574884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:07.574885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:07.575153 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:07.575296 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:07.575442 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 05:06:07.575594 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":111,"threads_started":1}
I20260808 05:06:07.577421 1651 catalog_manager.cc:1347] Generated new cluster ID: 2571484adf5f4187919f5aac06cf2421
I20260808 05:06:07.577482 1651 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:06:07.589591 1651 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:06:07.590301 1651 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:06:07.594933 1651 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Generated new TSK 0
I20260808 05:06:07.595115 1651 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:06:07.630440 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:34519
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:06:07.720886 1668 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:07.721131 1668 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:07.721172 1668 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:07.722426 1668 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:07.722508 1668 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:07.722555 1668 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:06:07.724330 1668 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:34519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1668
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:07.724601 1668 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:07.724855 1668 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:07.730163 1679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:07.730144 1675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:07.730373 1668 server_base.cc:1034] running on GCE node
W20260808 05:06:07.730250 1676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:07.730675 1668 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:07.730897 1668 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:07.732044 1668 hybrid_clock.cc:648] HybridClock initialized: now 1786165567732020 us; error 36 us; skew 500 ppm
Aug 08 05:06:07 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:07.734741 1668 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:06:07.735189 1668 webserver.cc:460] Webserver started at http://127.11.70.193:35513/ using document root <none> and password file <none>
I20260808 05:06:07.735428 1668 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:07.735481 1668 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:07.735657 1668 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:06:07.736790 1668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "53ca6ea72b2f409fa4086b44687863c6"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "9ed12a4adc09d5ca4ba33db53ec9b425"
server_key_iv: "2625b6a95a88a0d2c302b7726982343f"
server_key_version: "encryptionkey@0"
I20260808 05:06:07.737166 1668 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "53ca6ea72b2f409fa4086b44687863c6"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "9ed12a4adc09d5ca4ba33db53ec9b425"
server_key_iv: "2625b6a95a88a0d2c302b7726982343f"
server_key_version: "encryptionkey@0"
I20260808 05:06:07.738696 1668 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:06:07.739626 1687 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:07.739850 1668 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:07.739959 1668 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "53ca6ea72b2f409fa4086b44687863c6"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "9ed12a4adc09d5ca4ba33db53ec9b425"
server_key_iv: "2625b6a95a88a0d2c302b7726982343f"
server_key_version: "encryptionkey@0"
I20260808 05:06:07.740039 1668 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:07.749809 1668 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:07.752420 1668 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:07.752609 1668 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:07.752879 1668 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:06:07.753221 1668 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:06:07.753259 1668 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:07.753306 1668 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:06:07.753335 1668 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:07.760215 1668 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:42733
I20260808 05:06:07.760259 1854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:42733 every 8 connection(s)
I20260808 05:06:07.760838 1668 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:06:07.766741 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 1668
I20260808 05:06:07.766892 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:06:07.767122 11547 external_mini_cluster.cc:1428] Setting key b4fb0060f623ffe06189179f14e39e0f
Aug 08 05:06:07 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:06:07.771353 1639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:07.761671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:35853 (local address 127.11.70.254:34519)
0808 05:06:07.761749 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:07.761751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:07.762018 (+ 267us) server_negotiation.cc:407] Connection header received
0808 05:06:07.762623 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:07.762664 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:07.762678 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:07.762734 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:07.763772 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.764336 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.765374 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.765605 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.765674 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:07.768305 (+ 2631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:07.768306 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:07.768306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:07.768314 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:07.769780 (+ 1466us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:07.770223 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:07.770224 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:07.770225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:07.770291 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:07.770639 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:07.770640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:07.770641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:07.770771 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:07.770852 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:07.771150 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 05:06:07.771250 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:06:07.771572 1858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:07.761661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:35853)
0808 05:06:07.761838 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:07.761894 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:07.762435 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:07.762853 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:07.762857 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:07.763454 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:06:07.763656 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:07.763660 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.764429 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.764429 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:07.765273 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:07.765275 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.765696 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.765697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:07.765821 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:07.766366 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:06:07.766374 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:06:07.768182 (+ 1808us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:06:07.769871 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:07.769880 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:07.769883 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:07.770115 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:07.770370 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:07.770371 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:07.770371 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:07.770561 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:07.770843 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:06:07.770851 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:06:07.771007 (+ 156us) client_negotiation.cc:769] Sending connection context
0808 05:06:07.771114 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 05:06:07.771315 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":84,"threads_started":1}
I20260808 05:06:07.772104 1856 heartbeater.cc:347] Connected to a master server at 127.11.70.254:34519
I20260808 05:06:07.772203 1856 heartbeater.cc:464] Registering TS with master...
I20260808 05:06:07.772410 1856 heartbeater.cc:511] Master 127.11.70.254:34519 requested a full tablet report, sending...
I20260808 05:06:07.772969 1581 ts_manager.cc:194] Registered new tserver with Master: 53ca6ea72b2f409fa4086b44687863c6 (127.11.70.193:42733)
I20260808 05:06:07.773684 1581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:35853
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:06:07.798235 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:34519
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:06:07.885634 1862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:07.885871 1862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:07.885910 1862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:07.887110 1862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:07.887173 1862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:07.887218 1862 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:06:07.888715 1862 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:34519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1862
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:07.888981 1862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:07.889216 1862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:07.894557 1872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:07.894721 1862 server_base.cc:1034] running on GCE node
W20260808 05:06:07.894675 1870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:07.894567 1874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:07.895042 1862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:07.895303 1862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:07.896478 1862 hybrid_clock.cc:648] HybridClock initialized: now 1786165567896457 us; error 43 us; skew 500 ppm
Aug 08 05:06:07 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:07.899158 1862 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:06:07.899612 1862 webserver.cc:460] Webserver started at http://127.11.70.194:39055/ using document root <none> and password file <none>
I20260808 05:06:07.899818 1862 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:07.899861 1862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:07.899950 1862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:06:07.900942 1862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "edcda2fc386348ca91b9f266f825ff62"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "a3d4bb65f400b3e2bef1689f7af8fa19"
server_key_iv: "aa371c663275aecdcd23cca6131599bb"
server_key_version: "encryptionkey@0"
I20260808 05:06:07.901252 1862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "edcda2fc386348ca91b9f266f825ff62"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "a3d4bb65f400b3e2bef1689f7af8fa19"
server_key_iv: "aa371c663275aecdcd23cca6131599bb"
server_key_version: "encryptionkey@0"
I20260808 05:06:07.902623 1862 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 05:06:07.903475 1883 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:07.903709 1862 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:07.903803 1862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "edcda2fc386348ca91b9f266f825ff62"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "a3d4bb65f400b3e2bef1689f7af8fa19"
server_key_iv: "aa371c663275aecdcd23cca6131599bb"
server_key_version: "encryptionkey@0"
I20260808 05:06:07.903877 1862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:07.913390 1862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:07.915760 1862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:07.915910 1862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:07.916155 1862 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:06:07.916497 1862 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:06:07.916599 1862 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:07.916646 1862 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:06:07.916678 1862 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:07.922576 1862 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:38009
I20260808 05:06:07.922674 2044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:38009 every 8 connection(s)
I20260808 05:06:07.922991 1862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:06:07.924383 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 1862
I20260808 05:06:07.924512 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:06:07.924743 11547 external_mini_cluster.cc:1428] Setting key 89fe914fde2a99c894db42b550d2d033
Aug 08 05:06:07 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165567, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:06:07.934522 1639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:07.923878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:59239 (local address 127.11.70.254:34519)
0808 05:06:07.923945 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:07.923948 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:07.924176 (+ 228us) server_negotiation.cc:407] Connection header received
0808 05:06:07.924761 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:07.924763 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:07.924778 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:07.924866 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:07.926425 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.926984 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.928345 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.928657 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.928737 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:07.931115 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:07.931117 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:07.931117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:07.931127 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:07.932988 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:07.933414 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:07.933416 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:07.933417 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:07.933493 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:07.933761 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:07.933763 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:07.933763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:07.933932 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:07.934017 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:07.934276 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 05:06:07.934380 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:06:07.934598 2047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:07.923853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:59239)
0808 05:06:07.924036 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:07.924079 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:07.924652 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:07.925039 (+ 387us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:07.925045 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:07.925977 (+ 932us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:06:07.926289 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:07.926296 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.927083 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.927084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:07.928246 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:07.928249 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:07.928763 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:07.928763 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:07.928886 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:07.929511 (+ 625us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:06:07.929520 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:06:07.931015 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:06:07.933091 (+ 2076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:07.933098 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:07.933100 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:07.933331 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:07.933570 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:07.933571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:07.933571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:07.933679 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:07.934009 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:06:07.934014 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:06:07.934132 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 05:06:07.934216 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:06:07.934345 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":100,"threads_started":1}
I20260808 05:06:07.935148 2045 heartbeater.cc:347] Connected to a master server at 127.11.70.254:34519
I20260808 05:06:07.935286 2045 heartbeater.cc:464] Registering TS with master...
I20260808 05:06:07.935506 2045 heartbeater.cc:511] Master 127.11.70.254:34519 requested a full tablet report, sending...
I20260808 05:06:07.935981 1581 ts_manager.cc:194] Registered new tserver with Master: edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009)
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
I20260808 05:06:07.936591 1581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:59239
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:06:07.958997 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:34519
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:06:08.045710 2050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:08.045924 2050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:08.045948 2050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:08.047268 2050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:08.047322 2050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:08.047348 2050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:06:08.048827 2050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:34519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:08.049077 2050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:08.049316 2050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:08.054569 2055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:08.054517 2057 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:08.054740 2050 server_base.cc:1034] running on GCE node
W20260808 05:06:08.054517 2060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:08.055003 2050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:08.055295 2050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:08.056478 2050 hybrid_clock.cc:648] HybridClock initialized: now 1786165568056465 us; error 28 us; skew 500 ppm
Aug 08 05:06:08 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165568, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:08.059237 2050 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:06:08.059648 2050 webserver.cc:460] Webserver started at http://127.11.70.195:34279/ using document root <none> and password file <none>
I20260808 05:06:08.059834 2050 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:08.059875 2050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:08.059975 2050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:06:08.060983 2050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201"
format_stamp: "Formatted at 2026-08-08 05:06:08 on dist-test-slave-7kzw"
server_key: "70a6b86c2087e88ecf9ae42a98df0bc6"
server_key_iv: "d3300a64423d37c4288d0a0b8c43f167"
server_key_version: "encryptionkey@0"
I20260808 05:06:08.061309 2050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201"
format_stamp: "Formatted at 2026-08-08 05:06:08 on dist-test-slave-7kzw"
server_key: "70a6b86c2087e88ecf9ae42a98df0bc6"
server_key_iv: "d3300a64423d37c4288d0a0b8c43f167"
server_key_version: "encryptionkey@0"
I20260808 05:06:08.062783 2050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:06:08.063589 2068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:08.063795 2050 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:08.063912 2050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201"
format_stamp: "Formatted at 2026-08-08 05:06:08 on dist-test-slave-7kzw"
server_key: "70a6b86c2087e88ecf9ae42a98df0bc6"
server_key_iv: "d3300a64423d37c4288d0a0b8c43f167"
server_key_version: "encryptionkey@0"
I20260808 05:06:08.063992 2050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:08.073654 2050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:08.076306 2050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:08.076471 2050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:08.076700 2050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:06:08.077030 2050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:06:08.077064 2050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:08.077111 2050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:06:08.077139 2050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:08.083331 2050 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:42729
I20260808 05:06:08.083405 2226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:42729 every 8 connection(s)
I20260808 05:06:08.083767 2050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:06:08.085194 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 2050
I20260808 05:06:08.085311 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:06:08.085469 11547 external_mini_cluster.cc:1428] Setting key 5a8c92460aadc2a4e5b0ce00b2f521ec
Aug 08 05:06:08 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165568, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:06:08.093645 1639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.084640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:59309 (local address 127.11.70.254:34519)
0808 05:06:08.084710 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:08.084712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:08.084856 (+ 144us) server_negotiation.cc:407] Connection header received
0808 05:06:08.085342 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:08.085343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:08.085358 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:08.085409 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:08.086737 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.087270 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.088317 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.088515 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.088603 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.090862 (+ 2259us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:08.090863 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:08.090864 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:08.090872 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:08.092192 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:08.092614 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:08.092616 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:08.092616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:08.092679 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:08.092954 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:08.092955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:08.092955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:08.093075 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:08.093162 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:08.093459 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 05:06:08.093549 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:06:08.093840 2229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.084513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:59309)
0808 05:06:08.084680 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:08.084724 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:08.085211 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:08.085478 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:08.085483 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:08.086342 (+ 859us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:06:08.086638 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.086644 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.087375 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.087376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.088185 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.088187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.088618 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.088619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.088760 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.089353 (+ 593us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:06:08.089361 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:06:08.090760 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:06:08.092285 (+ 1525us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:08.092293 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:08.092295 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:08.092526 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:08.092753 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:08.092754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:08.092754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:08.092881 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:08.093156 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:06:08.093164 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:06:08.093317 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 05:06:08.093438 (+ 121us) client_negotiation.cc:240] Negotiation successful
0808 05:06:08.093596 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260808 05:06:08.094343 2227 heartbeater.cc:347] Connected to a master server at 127.11.70.254:34519
I20260808 05:06:08.094445 2227 heartbeater.cc:464] Registering TS with master...
I20260808 05:06:08.094668 2227 heartbeater.cc:511] Master 127.11.70.254:34519 requested a full tablet report, sending...
I20260808 05:06:08.095109 1581 ts_manager.cc:194] Registered new tserver with Master: 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729)
I20260808 05:06:08.095460 1581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:59309
I20260808 05:06:08.097227 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:06:08.104502 1639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.098601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47436 (local address 127.11.70.254:34519)
0808 05:06:08.098639 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:08.098641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:08.098791 (+ 150us) server_negotiation.cc:407] Connection header received
0808 05:06:08.098824 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:08.098824 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:08.098834 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:08.098879 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:08.099373 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.099817 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.100618 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.100827 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.100881 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.101987 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:08.101988 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:08.101989 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:08.101995 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:08.103399 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:08.103766 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:08.103767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:08.103767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:08.103821 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:08.104008 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:08.104009 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:08.104009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:08.104154 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:08.104231 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:08.104381 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 05:06:08.104439 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:06:08.106191 1581 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47436:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:06:08.108110 1581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:06:08.115307 2242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.110838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42733 (local address 127.0.0.1:48512)
0808 05:06:08.111230 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:08.111239 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:08.111291 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:08.111649 (+ 358us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:08.111649 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:08.111652 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:06:08.111711 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.111712 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.112643 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.112645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.113997 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.114000 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.114987 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.114988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.115071 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.115085 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:06:08.115155 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 05:06:08.115209 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":377,"mutex_wait_us":5,"thread_start_us":84,"threads_started":1}
I20260808 05:06:08.115789 2247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.111096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48512 (local address 127.11.70.193:42733)
0808 05:06:08.111319 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:08.111324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:08.111335 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:06:08.111375 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:08.111377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:08.111391 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:08.111491 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:06:08.111826 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.112531 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.114104 (+ 1573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.114802 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.114879 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.114943 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:08.115642 (+ 699us) server_negotiation.cc:299] Negotiation successful
0808 05:06:08.115698 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":84,"threads_started":1}
I20260808 05:06:08.115798 2243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.110803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36288 (local address 127.11.70.194:38009)
0808 05:06:08.111092 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:08.111095 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:08.111103 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:06:08.111159 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:08.111161 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:08.111180 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:08.111269 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:06:08.111554 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.112716 (+ 1162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.114873 (+ 2157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.115411 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.115489 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.115547 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:08.115658 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 05:06:08.115712 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":80,"threads_started":1}
I20260808 05:06:08.115862 2244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.110824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43852 (local address 127.11.70.195:42729)
0808 05:06:08.111017 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:08.111021 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:08.111166 (+ 145us) server_negotiation.cc:407] Connection header received
0808 05:06:08.111215 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:08.111217 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:08.111233 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:08.111304 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:06:08.111555 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.112716 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.114507 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.115277 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.115351 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.115409 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:08.115726 (+ 317us) server_negotiation.cc:299] Negotiation successful
0808 05:06:08.115770 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":83,"threads_started":1}
I20260808 05:06:08.115645 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.110652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:42729 (local address 127.0.0.1:43852)
0808 05:06:08.111077 (+ 425us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:08.111087 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:08.111151 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:08.111386 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:08.111387 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:08.111388 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:06:08.111466 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.111469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.112823 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.112824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.114373 (+ 1549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.114375 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.115371 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.115372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.115436 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.115441 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:06:08.115495 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:06:08.115538 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":394,"thread_start_us":107,"threads_started":1}
I20260808 05:06:08.115743 2240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.110606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:38009 (local address 127.0.0.1:36288)
0808 05:06:08.110732 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:08.110784 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:08.110848 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:08.111380 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:08.111383 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:08.111385 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:06:08.111466 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.111468 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.113733 (+ 2265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.113734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.114777 (+ 1043us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.114779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.115505 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.115506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.115568 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.115572 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:06:08.115630 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:06:08.115671 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"mutex_wait_us":9,"thread_start_us":78,"threads_started":1}
I20260808 05:06:08.116791 2138 tablet_service.cc:1467] Processing CreateTablet for tablet 58c6b112dc58420ba2c4c0c43cb80e22 (DEFAULT_TABLE table=test-table [id=f717be83646d4697a51f66ab7ad100a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:06:08.116858 1950 tablet_service.cc:1467] Processing CreateTablet for tablet 58c6b112dc58420ba2c4c0c43cb80e22 (DEFAULT_TABLE table=test-table [id=f717be83646d4697a51f66ab7ad100a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:06:08.117194 2138 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58c6b112dc58420ba2c4c0c43cb80e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:06:08.117223 1950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58c6b112dc58420ba2c4c0c43cb80e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:06:08.119185 1759 tablet_service.cc:1467] Processing CreateTablet for tablet 58c6b112dc58420ba2c4c0c43cb80e22 (DEFAULT_TABLE table=test-table [id=f717be83646d4697a51f66ab7ad100a0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:06:08.119534 1759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 58c6b112dc58420ba2c4c0c43cb80e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:06:08.120232 2249 tablet_bootstrap.cc:492] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Bootstrap starting.
I20260808 05:06:08.120855 2249 tablet_bootstrap.cc:654] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Neither blocks nor log segments found. Creating new log.
I20260808 05:06:08.121304 2249 log.cc:824] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:08.122031 2249 tablet_bootstrap.cc:492] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: No bootstrap required, opened a new log
I20260808 05:06:08.122078 2249 ts_tablet_manager.cc:1397] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:06:08.122359 2253 tablet_bootstrap.cc:492] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Bootstrap starting.
I20260808 05:06:08.122866 2251 tablet_bootstrap.cc:492] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: Bootstrap starting.
I20260808 05:06:08.123086 2253 tablet_bootstrap.cc:654] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Neither blocks nor log segments found. Creating new log.
I20260808 05:06:08.123582 2251 tablet_bootstrap.cc:654] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: Neither blocks nor log segments found. Creating new log.
I20260808 05:06:08.123701 2253 log.cc:824] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:08.124207 2251 log.cc:824] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:08.124215 2249 raft_consensus.cc:348] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:08.124402 2249 raft_consensus.cc:374] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:06:08.124446 2249 raft_consensus.cc:729] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5cbb3c3ee0459eb2f8b84e7efe3201, State: Initialized, Role: FOLLOWER
I20260808 05:06:08.124577 2253 tablet_bootstrap.cc:492] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: No bootstrap required, opened a new log
I20260808 05:06:08.124562 2249 consensus_queue.cc:260] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:08.124670 2253 ts_tablet_manager.cc:1397] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:06:08.124835 2249 ts_tablet_manager.cc:1428] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:06:08.124969 2251 tablet_bootstrap.cc:492] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: No bootstrap required, opened a new log
I20260808 05:06:08.124981 2227 heartbeater.cc:503] Master 127.11.70.254:34519 was elected leader, sending a full tablet report...
I20260808 05:06:08.125041 2251 ts_tablet_manager.cc:1397] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:06:08.126765 2253 raft_consensus.cc:348] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:08.126952 2253 raft_consensus.cc:374] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:06:08.126992 2253 raft_consensus.cc:729] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ca6ea72b2f409fa4086b44687863c6, State: Initialized, Role: FOLLOWER
I20260808 05:06:08.127106 2253 consensus_queue.cc:260] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:08.127081 2251 raft_consensus.cc:348] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:08.127270 2251 raft_consensus.cc:374] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:06:08.127332 2251 raft_consensus.cc:729] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcda2fc386348ca91b9f266f825ff62, State: Initialized, Role: FOLLOWER
I20260808 05:06:08.127422 2253 ts_tablet_manager.cc:1428] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:06:08.127447 2251 consensus_queue.cc:260] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:08.127693 2251 ts_tablet_manager.cc:1428] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:06:08.127767 2045 heartbeater.cc:503] Master 127.11.70.254:34519 was elected leader, sending a full tablet report...
I20260808 05:06:08.127951 1856 heartbeater.cc:503] Master 127.11.70.254:34519 was elected leader, sending a full tablet report...
W20260808 05:06:08.173612 2046 tablet.cc:2369] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:06:08.251243 2257 raft_consensus.cc:482] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:06:08.251377 2257 raft_consensus.cc:504] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:08.251776 2257 leader_election.cc:288] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009), 53ca6ea72b2f409fa4086b44687863c6 (127.11.70.193:42733)
I20260808 05:06:08.255043 2243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.252103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:46413 (local address 127.11.70.194:38009)
0808 05:06:08.252189 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:08.252191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:08.252203 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:06:08.252311 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:08.252312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:08.252328 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:08.252386 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:06:08.252619 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.253176 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.254147 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.254650 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.254729 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.254739 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:08.254912 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 05:06:08.254963 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260808 05:06:08.255061 2229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.252018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:38009 (local address 127.11.70.195:46413)
0808 05:06:08.252081 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:08.252092 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:08.252191 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:08.252403 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:08.252404 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:08.252406 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:06:08.252490 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.252492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.253268 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.253269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.254041 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.254043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.254746 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.254747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.254832 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.254838 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:06:08.254885 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 05:06:08.254921 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 05:06:08.255084 2247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.252424 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:57921 (local address 127.11.70.193:42733)
0808 05:06:08.252480 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:08.252482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:08.252490 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:06:08.252517 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:08.252519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:08.252531 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:08.252589 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:06:08.252781 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.253267 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.254220 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.254717 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.254791 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.254800 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:08.254969 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 05:06:08.255015 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:06:08.255352 2260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.252152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42733 (local address 127.11.70.195:57921)
0808 05:06:08.252346 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:08.252359 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:08.252421 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:08.252614 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:08.252615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:08.252617 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:06:08.252696 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.252698 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.253355 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.253356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.254128 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:08.254132 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.254810 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.254811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:08.254888 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.254893 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:06:08.254948 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 05:06:08.254985 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":132,"threads_started":1}
I20260808 05:06:08.255532 1978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c6b112dc58420ba2c4c0c43cb80e22" candidate_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcda2fc386348ca91b9f266f825ff62" is_pre_election: true
I20260808 05:06:08.255736 1978 raft_consensus.cc:2454] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5cbb3c3ee0459eb2f8b84e7efe3201 in term 0.
I20260808 05:06:08.255710 1781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c6b112dc58420ba2c4c0c43cb80e22" candidate_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ca6ea72b2f409fa4086b44687863c6" is_pre_election: true
I20260808 05:06:08.255863 1781 raft_consensus.cc:2454] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5cbb3c3ee0459eb2f8b84e7efe3201 in term 0.
I20260808 05:06:08.255993 2069 leader_election.cc:302] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5cbb3c3ee0459eb2f8b84e7efe3201, edcda2fc386348ca91b9f266f825ff62; no voters:
I20260808 05:06:08.256177 2257 raft_consensus.cc:2781] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:06:08.256263 2257 raft_consensus.cc:482] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:06:08.256294 2257 raft_consensus.cc:3037] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:06:08.257014 2257 raft_consensus.cc:504] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:08.257166 2257 leader_election.cc:288] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [CANDIDATE]: Term 1 election: Requested vote from peers edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009), 53ca6ea72b2f409fa4086b44687863c6 (127.11.70.193:42733)
I20260808 05:06:08.257342 1978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c6b112dc58420ba2c4c0c43cb80e22" candidate_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcda2fc386348ca91b9f266f825ff62"
I20260808 05:06:08.257426 1978 raft_consensus.cc:3037] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:06:08.257422 1781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58c6b112dc58420ba2c4c0c43cb80e22" candidate_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ca6ea72b2f409fa4086b44687863c6"
I20260808 05:06:08.257514 1781 raft_consensus.cc:3037] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:06:08.258219 1978 raft_consensus.cc:2454] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5cbb3c3ee0459eb2f8b84e7efe3201 in term 1.
I20260808 05:06:08.258253 1781 raft_consensus.cc:2454] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5cbb3c3ee0459eb2f8b84e7efe3201 in term 1.
I20260808 05:06:08.258401 2069 leader_election.cc:302] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5cbb3c3ee0459eb2f8b84e7efe3201, 53ca6ea72b2f409fa4086b44687863c6; no voters:
I20260808 05:06:08.258522 2257 raft_consensus.cc:2781] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:06:08.258710 2257 raft_consensus.cc:686] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 LEADER]: Becoming Leader. State: Replica: 4a5cbb3c3ee0459eb2f8b84e7efe3201, State: Running, Role: LEADER
I20260808 05:06:08.258826 2257 consensus_queue.cc:237] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:08.259680 1581 catalog_manager.cc:5495] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } health_report { overall_health: HEALTHY } } }
W20260808 05:06:08.261705 1857 tablet.cc:2369] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:06:08.297219 2244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.294665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43868 (local address 127.11.70.195:42729)
0808 05:06:08.294735 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:08.294738 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:08.294782 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:06:08.294827 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:08.294828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:08.294847 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:08.294926 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:06:08.295065 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.295562 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.296399 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:08.296590 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:08.296674 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:08.296844 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:06:08.296945 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:06:08.297036 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:08.297077 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 05:06:08.297099 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:06:08.299263 1978 raft_consensus.cc:1261] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [term 1 FOLLOWER]: Refusing update from remote peer 4a5cbb3c3ee0459eb2f8b84e7efe3201: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:06:08.299293 1781 raft_consensus.cc:1261] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Refusing update from remote peer 4a5cbb3c3ee0459eb2f8b84e7efe3201: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:06:08.299659 2261 consensus_queue.cc:1035] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:06:08.299823 2257 consensus_queue.cc:1035] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:06:08.303033 2266 mvcc.cc:205] Tried to move back new op lower bound from 7316134167750725632 to 7316134167589068800. Current Snapshot: MvccSnapshot[applied={T|T < 7316134167750725632}]
I20260808 05:06:08.304567 1581 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:06:08.304673 1581 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47436:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:06:08.305465 1581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Sending DeleteTablet for 3 replicas of tablet 58c6b112dc58420ba2c4c0c43cb80e22
I20260808 05:06:08.305821 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 1668
I20260808 05:06:08.305825 2138 tablet_service.cc:1514] Processing DeleteTablet for tablet 58c6b112dc58420ba2c4c0c43cb80e22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:06:08 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:43852
I20260808 05:06:08.305882 1950 tablet_service.cc:1514] Processing DeleteTablet for tablet 58c6b112dc58420ba2c4c0c43cb80e22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:06:08 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:36288
I20260808 05:06:08.314685 2277 tablet_replica.cc:330] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: stopping tablet replica
I20260808 05:06:08.314874 2277 raft_consensus.cc:2229] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:06:08.315056 2277 raft_consensus.cc:2258] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:06:08.316314 2276 tablet_replica.cc:330] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: stopping tablet replica
I20260808 05:06:08.316433 2276 raft_consensus.cc:2229] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:06:08.316543 2276 raft_consensus.cc:2258] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:06:08.317009 2276 ts_tablet_manager.cc:1905] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:06:08.317026 2277 ts_tablet_manager.cc:1905] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:06:08.318922 2276 ts_tablet_manager.cc:1918] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:06:08.319072 2276 log.cc:1196] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/58c6b112dc58420ba2c4c0c43cb80e22
I20260808 05:06:08.319195 2277 ts_tablet_manager.cc:1918] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:06:08.319371 2277 log.cc:1196] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/58c6b112dc58420ba2c4c0c43cb80e22
I20260808 05:06:08.319450 2276 ts_tablet_manager.cc:1939] T 58c6b112dc58420ba2c4c0c43cb80e22 P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Deleting consensus metadata
I20260808 05:06:08.319730 2277 ts_tablet_manager.cc:1939] T 58c6b112dc58420ba2c4c0c43cb80e22 P edcda2fc386348ca91b9f266f825ff62: Deleting consensus metadata
I20260808 05:06:08.319993 1559 catalog_manager.cc:4841] TS 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729): tablet 58c6b112dc58420ba2c4c0c43cb80e22 (table test-table [id=f717be83646d4697a51f66ab7ad100a0]) successfully deleted
I20260808 05:06:08.320217 1555 catalog_manager.cc:4841] TS edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009): tablet 58c6b112dc58420ba2c4c0c43cb80e22 (table test-table [id=f717be83646d4697a51f66ab7ad100a0]) successfully deleted
W20260808 05:06:08.322252 1555 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:42733 (error 108)
I20260808 05:06:08.322600 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 1862
I20260808 05:06:08.324108 2246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:08.322700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42733 (local address 127.0.0.1:48516)
0808 05:06:08.324029 (+ 1329us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:08.324069 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:42733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1304}
W20260808 05:06:08.331236 1555 catalog_manager.cc:4584] TS 53ca6ea72b2f409fa4086b44687863c6 (127.11.70.193:42733): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 58c6b112dc58420ba2c4c0c43cb80e22: Network error: Client connection negotiation failed: client connection to 127.11.70.193:42733: connect: Connection refused (error 111)
I20260808 05:06:08.336845 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 2050
I20260808 05:06:08.348400 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 1530
I20260808 05:06:28.358932 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34519
--webserver_interface=127.11.70.254
--webserver_port=39659
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:34519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:06:28.442595 2280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:28.442782 2280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:28.442804 2280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:28.443948 2280 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 05:06:28.443988 2280 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 05:06:28.444002 2280 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 05:06:28.444013 2280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:06:28.444026 2280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:28.444072 2280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:28.444103 2280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:06:28.444120 2280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:06:28.445917 2280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:34519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=39659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:28.446215 2280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:28.446517 2280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:28.456432 2287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:28.456439 2289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:28.456528 2286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:28.456681 2280 server_base.cc:1034] running on GCE node
I20260808 05:06:28.457022 2280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:28.457406 2280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:28.458536 2280 hybrid_clock.cc:648] HybridClock initialized: now 1786165588458518 us; error 27 us; skew 500 ppm
Aug 08 05:06:28 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:28.465395 2280 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:06:28.465808 2280 webserver.cc:460] Webserver started at http://127.11.70.254:39659/ using document root <none> and password file <none>
I20260808 05:06:28.466019 2280 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:28.466079 2280 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:28.467563 2280 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:28.468276 2301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:28.468497 2280 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:28.468611 2280 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "2fd827cb3db14ff883eca90c002df52a"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "197690460d3b570cff8f2458a51d73ae"
server_key_iv: "e75deae9fe8b3c87b12670b9d2b1b69c"
server_key_version: "encryptionkey@0"
I20260808 05:06:28.469018 2280 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:28.476974 2280 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:28.479166 2280 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:28.479318 2280 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:28.483470 2280 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:34519
I20260808 05:06:28.483505 2379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:34519 every 8 connection(s)
I20260808 05:06:28.483906 2280 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:06:28.485426 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 2280
I20260808 05:06:28.485442 2380 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:06:28.485745 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:42733
--local_ip_for_outbound_sockets=127.11.70.193
--tserver_master_addrs=127.11.70.254:34519
--webserver_port=35513
--webserver_interface=127.11.70.193
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:06:28.486210 2380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Bootstrap starting.
I20260808 05:06:28.495950 2380 log.cc:824] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:28.498139 2380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:06:28.498454 2380 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Bootstrap complete.
I20260808 05:06:28.501094 2380 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:28.501346 2380 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fd827cb3db14ff883eca90c002df52a, State: Initialized, Role: FOLLOWER
I20260808 05:06:28.501539 2380 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:28.501624 2380 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:06:28.501684 2380 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:06:28.501735 2380 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:06:28.502812 2380 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:28.502933 2380 leader_election.cc:302] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fd827cb3db14ff883eca90c002df52a; no voters:
I20260808 05:06:28.503156 2380 leader_election.cc:288] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:06:28.503194 2386 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:06:28.503314 2386 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 2 LEADER]: Becoming Leader. State: Replica: 2fd827cb3db14ff883eca90c002df52a, State: Running, Role: LEADER
I20260808 05:06:28.503443 2380 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:06:28.503461 2386 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:28.503860 2388 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "2fd827cb3db14ff883eca90c002df52a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } } }
I20260808 05:06:28.503952 2388 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: This master's current role is: LEADER
I20260808 05:06:28.504268 2389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fd827cb3db14ff883eca90c002df52a. Latest consensus state: current_term: 2 leader_uuid: "2fd827cb3db14ff883eca90c002df52a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } } }
I20260808 05:06:28.504343 2394 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:06:28.505230 2394 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:06:28.505336 2394 catalog_manager.cc:1259] Loaded cluster ID: 2571484adf5f4187919f5aac06cf2421
I20260808 05:06:28.505427 2394 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:06:28.506759 2394 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:06:28.506965 2394 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Loaded TSK: 0
I20260808 05:06:28.504415 2389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: This master's current role is: LEADER
I20260808 05:06:28.519466 2394 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Generated new TSK 1
I20260808 05:06:28.519591 2394 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:06:28.577725 2383 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:28.577946 2383 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:28.577971 2383 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:28.579207 2383 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:28.579262 2383 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:28.579289 2383 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:06:28.580796 2383 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:42733
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=35513
--tserver_master_addrs=127.11.70.254:34519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2383
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:28.581040 2383 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:28.581305 2383 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:28.587512 2423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:28.587532 2420 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:28.587734 2383 server_base.cc:1034] running on GCE node
W20260808 05:06:28.587549 2419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:28.588063 2383 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:28.588340 2383 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:28.589530 2383 hybrid_clock.cc:648] HybridClock initialized: now 1786165588589516 us; error 29 us; skew 500 ppm
Aug 08 05:06:28 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:28.592717 2383 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:06:28.593199 2383 webserver.cc:460] Webserver started at http://127.11.70.193:35513/ using document root <none> and password file <none>
I20260808 05:06:28.593434 2383 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:28.593526 2383 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:28.595041 2383 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:06:28.595826 2433 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:28.596011 2383 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:28.596124 2383 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "53ca6ea72b2f409fa4086b44687863c6"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "9ed12a4adc09d5ca4ba33db53ec9b425"
server_key_iv: "2625b6a95a88a0d2c302b7726982343f"
server_key_version: "encryptionkey@0"
I20260808 05:06:28.596529 2383 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:28.605139 2383 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:28.607427 2383 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:28.607592 2383 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:28.607826 2383 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:06:28.608301 2441 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:06:28.610195 2383 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:06:28.610263 2383 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 05:06:28.610327 2383 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:06:28.611052 2383 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:06:28.611112 2383 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 05:06:28.611174 2441 tablet_bootstrap.cc:492] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Bootstrap starting.
I20260808 05:06:28.618845 2383 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:42733
I20260808 05:06:28.618891 2592 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:42733 every 8 connection(s)
I20260808 05:06:28.619302 2383 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:06:28.622520 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 2383
I20260808 05:06:28.622730 2441 log.cc:824] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:28.622859 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:38009
--local_ip_for_outbound_sockets=127.11.70.194
--tserver_master_addrs=127.11.70.254:34519
--webserver_port=39055
--webserver_interface=127.11.70.194
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:06:28.625548 2441 tablet_bootstrap.cc:492] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:06:28.625869 2441 tablet_bootstrap.cc:492] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Bootstrap complete.
I20260808 05:06:28.627223 2441 ts_tablet_manager.cc:1397] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.015s
I20260808 05:06:28.628938 2441 raft_consensus.cc:348] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:28.629362 2441 raft_consensus.cc:729] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ca6ea72b2f409fa4086b44687863c6, State: Initialized, Role: FOLLOWER
I20260808 05:06:28.629587 2441 consensus_queue.cc:260] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } } peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } }
I20260808 05:06:28.629933 2441 ts_tablet_manager.cc:1428] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
Aug 08 05:06:28 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:06:28.635529 2596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.620034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:43787)
0808 05:06:28.620235 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:28.620279 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:28.620720 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:28.623124 (+ 2404us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:28.623129 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:28.623529 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:06:28.623958 (+ 429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.623966 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.625844 (+ 1878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.625845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.627194 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.627197 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.628065 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.628066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.628240 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.628877 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:06:28.628889 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:06:28.630931 (+ 2042us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:06:28.633409 (+ 2478us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:28.633418 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:28.633420 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:28.633769 (+ 349us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:28.634073 (+ 304us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:28.634074 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:28.634075 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:28.634258 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:28.634880 (+ 622us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:06:28.634886 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:06:28.635034 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 05:06:28.635148 (+ 114us) client_negotiation.cc:240] Negotiation successful
0808 05:06:28.635333 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":117,"threads_started":1}
I20260808 05:06:28.635663 2597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.620156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:43787 (local address 127.11.70.254:34519)
0808 05:06:28.622643 (+ 2487us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.622653 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.622701 (+ 48us) server_negotiation.cc:407] Connection header received
0808 05:06:28.622851 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.622858 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.622916 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.624129 (+ 1213us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:28.624235 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.625691 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.627331 (+ 1640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.627933 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.628573 (+ 640us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.631068 (+ 2495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:28.631087 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:28.631088 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:28.631100 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:28.633310 (+ 2210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.633867 (+ 557us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.633871 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.633871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.633988 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.634348 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.634349 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.634349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.634757 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:28.634849 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.635250 (+ 401us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.635414 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2423,"thread_start_us":91,"threads_started":1}
I20260808 05:06:28.636658 2594 heartbeater.cc:347] Connected to a master server at 127.11.70.254:34519
I20260808 05:06:28.636757 2594 heartbeater.cc:464] Registering TS with master...
I20260808 05:06:28.636934 2594 heartbeater.cc:511] Master 127.11.70.254:34519 requested a full tablet report, sending...
I20260808 05:06:28.637838 2325 ts_manager.cc:194] Registered new tserver with Master: 53ca6ea72b2f409fa4086b44687863c6 (127.11.70.193:42733)
I20260808 05:06:28.639037 2325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:43787
I20260808 05:06:28.640029 2594 heartbeater.cc:503] Master 127.11.70.254:34519 was elected leader, sending a full tablet report...
Aug 08 05:06:28 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.193@KRBTEST.COM
I20260808 05:06:28.648319 2604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.638759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42733 (local address 127.0.0.1:36178)
0808 05:06:28.639036 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:28.639069 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:28.639152 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:28.639395 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:28.639399 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:28.639725 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:06:28.639783 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.639785 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.641128 (+ 1343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.641129 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.642021 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.642023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.642680 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.642681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.642761 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.643279 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:06:28.643284 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:06:28.644945 (+ 1661us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:06:28.646984 (+ 2039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:28.646992 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:28.646994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:28.647287 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:28.647532 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:28.647533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:28.647534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:28.647606 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:28.647937 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:06:28.647944 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:06:28.647999 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 05:06:28.648086 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:06:28.648207 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":77,"threads_started":1}
I20260808 05:06:28.648339 2602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.638600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36178 (local address 127.11.70.193:42733)
0808 05:06:28.638973 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.638978 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.639229 (+ 251us) server_negotiation.cc:407] Connection header received
0808 05:06:28.639264 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.639266 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.639280 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.639337 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:28.639871 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.641039 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.642112 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.642592 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.642658 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.645042 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:28.645051 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:28.645051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:28.645058 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:28.646897 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.647381 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.647385 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.647385 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.647454 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.647678 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.647679 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.647680 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.647857 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:28.647948 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.648145 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.648252 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":342,"thread_start_us":87,"threads_started":1}
I20260808 05:06:28.649158 2496 tablet_service.cc:1514] Processing DeleteTablet for tablet 58c6b112dc58420ba2c4c0c43cb80e22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:06:08 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:36178
I20260808 05:06:28.649745 2605 tablet_replica.cc:330] stopping tablet replica
I20260808 05:06:28.649858 2605 raft_consensus.cc:2229] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:06:28.649931 2605 raft_consensus.cc:2258] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:06:28.650265 2605 ts_tablet_manager.cc:1905] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:06:28.652508 2605 ts_tablet_manager.cc:1918] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:06:28.652588 2605 log.cc:1196] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal/wals/58c6b112dc58420ba2c4c0c43cb80e22
I20260808 05:06:28.652818 2605 ts_tablet_manager.cc:1939] T 58c6b112dc58420ba2c4c0c43cb80e22 P 53ca6ea72b2f409fa4086b44687863c6: Deleting consensus metadata
I20260808 05:06:28.653441 2302 catalog_manager.cc:4841] TS 53ca6ea72b2f409fa4086b44687863c6 (127.11.70.193:42733): tablet 58c6b112dc58420ba2c4c0c43cb80e22 (table test-table [id=f717be83646d4697a51f66ab7ad100a0]) successfully deleted
W20260808 05:06:28.715325 2599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:28.715570 2599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:28.715619 2599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:28.716790 2599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:28.716861 2599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:28.716903 2599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:06:28.718372 2599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:38009
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=39055
--tserver_master_addrs=127.11.70.254:34519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:28.718672 2599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:28.718917 2599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:28.724052 2612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:28.724059 2614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:28.724059 2616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:28.724256 2599 server_base.cc:1034] running on GCE node
I20260808 05:06:28.724483 2599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:28.724680 2599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:28.725845 2599 hybrid_clock.cc:648] HybridClock initialized: now 1786165588725835 us; error 39 us; skew 500 ppm
Aug 08 05:06:28 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:28.728507 2599 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:06:28.728994 2599 webserver.cc:460] Webserver started at http://127.11.70.194:39055/ using document root <none> and password file <none>
I20260808 05:06:28.729230 2599 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:28.729310 2599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:28.730739 2599 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:28.731379 2627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:28.731570 2599 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:28.731673 2599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "edcda2fc386348ca91b9f266f825ff62"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "a3d4bb65f400b3e2bef1689f7af8fa19"
server_key_iv: "aa371c663275aecdcd23cca6131599bb"
server_key_version: "encryptionkey@0"
I20260808 05:06:28.732012 2599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:28.744922 2599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:28.747373 2599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:28.747540 2599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:28.747782 2599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:06:28.748106 2599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:06:28.748144 2599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:28.748168 2599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:06:28.748181 2599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:28.754675 2599 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:38009
I20260808 05:06:28.754736 2782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:38009 every 8 connection(s)
I20260808 05:06:28.755072 2599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:06:28.760752 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 2599
I20260808 05:06:28.761065 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:42729
--local_ip_for_outbound_sockets=127.11.70.195
--tserver_master_addrs=127.11.70.254:34519
--webserver_port=34279
--webserver_interface=127.11.70.195
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:06:28 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:06:28.765336 2786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.755724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:39527)
0808 05:06:28.755931 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:28.755981 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:28.756502 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:28.756783 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:28.756786 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:28.757624 (+ 838us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:06:28.757825 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.757831 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.758582 (+ 751us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.758584 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.759385 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.759387 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.759818 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.759819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.759953 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.760507 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:06:28.760515 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:06:28.762124 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:06:28.763989 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:28.763996 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:28.763998 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:28.764219 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:28.764435 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:28.764436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:28.764436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:28.764536 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:28.764863 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:06:28.764868 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:06:28.764982 (+ 114us) client_negotiation.cc:769] Sending connection context
0808 05:06:28.765062 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:06:28.765180 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":76,"threads_started":1}
I20260808 05:06:28.765354 2597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.755953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:39527 (local address 127.11.70.254:34519)
0808 05:06:28.755999 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.756001 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.756059 (+ 58us) server_negotiation.cc:407] Connection header received
0808 05:06:28.756623 (+ 564us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.756624 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.756640 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.756707 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:28.757934 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.758438 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.759482 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.759699 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.759809 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.762227 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:28.762229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:28.762229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:28.762236 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:28.763902 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.764296 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.764297 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.764298 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.764366 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.764643 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.764644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.764644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.764794 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:28.764868 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.765112 (+ 244us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.765215 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:06:28.766160 2783 heartbeater.cc:347] Connected to a master server at 127.11.70.254:34519
I20260808 05:06:28.766274 2783 heartbeater.cc:464] Registering TS with master...
I20260808 05:06:28.766507 2783 heartbeater.cc:511] Master 127.11.70.254:34519 requested a full tablet report, sending...
I20260808 05:06:28.766959 2325 ts_manager.cc:194] Registered new tserver with Master: edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009)
I20260808 05:06:28.767356 2325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:39527
W20260808 05:06:28.848414 2788 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:28.848613 2788 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:28.848639 2788 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:28.849772 2788 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:28.849815 2788 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:28.849841 2788 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:06:28.851354 2788 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:42729
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=34279
--tserver_master_addrs=127.11.70.254:34519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2788
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:28.851593 2788 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:28.851836 2788 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:28.856986 2799 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:28.857004 2797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:28.857172 2788 server_base.cc:1034] running on GCE node
W20260808 05:06:28.857016 2796 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:28.857445 2788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:28.857708 2788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:28.858876 2788 hybrid_clock.cc:648] HybridClock initialized: now 1786165588858858 us; error 53 us; skew 500 ppm
Aug 08 05:06:28 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:28.861478 2788 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:06:28.861992 2788 webserver.cc:460] Webserver started at http://127.11.70.195:34279/ using document root <none> and password file <none>
I20260808 05:06:28.862243 2788 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:28.862339 2788 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:28.863739 2788 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:06:28.864362 2807 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:28.864543 2788 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:06:28.864655 2788 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201"
format_stamp: "Formatted at 2026-08-08 05:06:08 on dist-test-slave-7kzw"
server_key: "70a6b86c2087e88ecf9ae42a98df0bc6"
server_key_iv: "d3300a64423d37c4288d0a0b8c43f167"
server_key_version: "encryptionkey@0"
I20260808 05:06:28.864971 2788 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:28.881487 2788 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:28.883955 2788 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:28.884141 2788 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:28.884400 2788 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:06:28.884738 2788 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:06:28.884793 2788 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:28.884831 2788 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:06:28.884879 2788 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:28.891183 2788 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:42729
I20260808 05:06:28.891227 2968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:42729 every 8 connection(s)
I20260808 05:06:28.891623 2788 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:06:28 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165588, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:06:28.898190 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 2788
I20260808 05:06:28.901804 2597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.892425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:56197 (local address 127.11.70.254:34519)
0808 05:06:28.892474 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.892476 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.892748 (+ 272us) server_negotiation.cc:407] Connection header received
0808 05:06:28.893202 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.893204 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.893217 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.893295 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:28.894206 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.894902 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.895954 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.896209 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.896278 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.898761 (+ 2483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:28.898763 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:28.898763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:28.898772 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:28.900412 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.900813 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.900815 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.900815 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.900877 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.901153 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.901154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.901154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.901270 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:28.901341 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.901629 (+ 288us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.901712 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:06:28.902002 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.892397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:56197)
0808 05:06:28.892557 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:28.892592 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:28.893098 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:28.893344 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:28.893347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:28.893914 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:06:28.894107 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.894112 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.895003 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.895004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.895855 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.895857 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.896294 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.896295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.896397 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.896907 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:06:28.896916 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:06:28.898641 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:06:28.900491 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:28.900498 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:28.900501 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:28.900733 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:28.900958 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:28.900959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:28.900959 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:28.901073 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:28.901343 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:06:28.901352 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:06:28.901489 (+ 137us) client_negotiation.cc:769] Sending connection context
0808 05:06:28.901598 (+ 109us) client_negotiation.cc:240] Negotiation successful
0808 05:06:28.901754 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":97,"threads_started":1}
I20260808 05:06:28.902607 2970 heartbeater.cc:347] Connected to a master server at 127.11.70.254:34519
I20260808 05:06:28.902719 2970 heartbeater.cc:464] Registering TS with master...
I20260808 05:06:28.903002 2970 heartbeater.cc:511] Master 127.11.70.254:34519 requested a full tablet report, sending...
I20260808 05:06:28.903446 2325 ts_manager.cc:194] Registered new tserver with Master: 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729)
I20260808 05:06:28.903942 2325 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:56197
I20260808 05:06:28.905907 2980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.898639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45376 (local address 127.11.70.254:34519)
0808 05:06:28.898753 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.898755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.898948 (+ 193us) server_negotiation.cc:407] Connection header received
0808 05:06:28.899068 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.899069 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.899083 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.899149 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:28.899970 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.900557 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.901340 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.901543 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.901617 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.903372 (+ 1755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:28.903373 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:28.903374 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:28.903381 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:28.904932 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.905256 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.905257 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.905257 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.905311 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:28.905433 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:28.905434 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:28.905434 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:28.905514 (+ 80us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:28.905671 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.905702 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.905793 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":58,"threads_started":1}
I20260808 05:06:28.906634 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:06:28.909035 2980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.906923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45392 (local address 127.11.70.254:34519)
0808 05:06:28.906956 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.906958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.907108 (+ 150us) server_negotiation.cc:407] Connection header received
0808 05:06:28.907137 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.907138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.907166 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.907214 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:06:28.907296 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.907713 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.908403 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.908582 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.908630 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.908735 (+ 105us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:06:28.908832 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:06:28.908887 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.908926 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.908943 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:06:28.909292 2325 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:45392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:06:28.911036 2325 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:06:28.913357 2496 tablet_service.cc:1467] Processing CreateTablet for tablet 96a78e8b8ca94b4da184a785edb6519d (DEFAULT_TABLE table=test-table [id=92ac10d4496d413db953ffdd86946f92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:06:28.913650 2496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96a78e8b8ca94b4da184a785edb6519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:06:28.915335 2441 tablet_bootstrap.cc:492] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Bootstrap starting.
I20260808 05:06:28.915712 2441 tablet_bootstrap.cc:654] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Neither blocks nor log segments found. Creating new log.
I20260808 05:06:28.916347 2441 tablet_bootstrap.cc:492] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: No bootstrap required, opened a new log
I20260808 05:06:28.916419 2441 ts_tablet_manager.cc:1397] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:06:28.916778 2441 raft_consensus.cc:348] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:28.916851 2441 raft_consensus.cc:374] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:06:28.916893 2441 raft_consensus.cc:729] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ca6ea72b2f409fa4086b44687863c6, State: Initialized, Role: FOLLOWER
I20260808 05:06:28.916940 2441 consensus_queue.cc:260] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:28.916949 2604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.912853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:42729 (local address 127.0.0.1:34220)
0808 05:06:28.912902 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:28.912913 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:28.912950 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:28.913429 (+ 479us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:28.913430 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:28.913431 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:06:28.913476 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.913478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.914731 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.914732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.915786 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.915789 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.916671 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.916672 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.916752 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.916773 (+ 21us) client_negotiation.cc:769] Sending connection context
0808 05:06:28.916830 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:06:28.916879 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 05:06:28.916967 2984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.913010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34220 (local address 127.11.70.195:42729)
0808 05:06:28.913267 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.913271 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.913279 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:06:28.913310 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.913311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.913325 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.913392 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:06:28.913566 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.914633 (+ 1067us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.915876 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.916580 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.916669 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.916729 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.916857 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.916892 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":208,"thread_start_us":80,"threads_started":1}
I20260808 05:06:28.917033 2441 ts_tablet_manager.cc:1428] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:06:28.917778 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.912892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:38009 (local address 127.0.0.1:50808)
0808 05:06:28.913134 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:28.913144 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:28.913190 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:28.913823 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:28.913824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:28.913827 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:06:28.913870 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.913871 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.915130 (+ 1259us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.915131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.916324 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.916327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.917538 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.917539 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.917587 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.917590 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:06:28.917668 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:06:28.917707 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":104,"threads_started":1}
I20260808 05:06:28.917799 2985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.913000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50808 (local address 127.11.70.194:38009)
0808 05:06:28.913579 (+ 579us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.913583 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.913622 (+ 39us) server_negotiation.cc:407] Connection header received
0808 05:06:28.913661 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.913663 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.913679 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.913764 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:06:28.913959 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.915030 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.916413 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.917376 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.917447 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.917509 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.917683 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.917721 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":116,"threads_started":1}
I20260808 05:06:28.917811 2878 tablet_service.cc:1467] Processing CreateTablet for tablet 96a78e8b8ca94b4da184a785edb6519d (DEFAULT_TABLE table=test-table [id=92ac10d4496d413db953ffdd86946f92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:06:28.918216 2878 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96a78e8b8ca94b4da184a785edb6519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:06:28.918737 2684 tablet_service.cc:1467] Processing CreateTablet for tablet 96a78e8b8ca94b4da184a785edb6519d (DEFAULT_TABLE table=test-table [id=92ac10d4496d413db953ffdd86946f92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:06:28.919045 2684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 96a78e8b8ca94b4da184a785edb6519d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:06:28.921298 2990 tablet_bootstrap.cc:492] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Bootstrap starting.
I20260808 05:06:28.921888 2990 tablet_bootstrap.cc:654] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Neither blocks nor log segments found. Creating new log.
I20260808 05:06:28.921927 2991 tablet_bootstrap.cc:492] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: Bootstrap starting.
I20260808 05:06:28.922433 2990 log.cc:824] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:28.922546 2991 tablet_bootstrap.cc:654] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: Neither blocks nor log segments found. Creating new log.
I20260808 05:06:28.922976 2991 log.cc:824] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:28.923287 2990 tablet_bootstrap.cc:492] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: No bootstrap required, opened a new log
I20260808 05:06:28.923382 2990 ts_tablet_manager.cc:1397] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:06:28.923697 2991 tablet_bootstrap.cc:492] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: No bootstrap required, opened a new log
I20260808 05:06:28.923753 2991 ts_tablet_manager.cc:1397] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:06:28.925088 2990 raft_consensus.cc:348] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:28.925257 2990 raft_consensus.cc:374] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:06:28.925313 2990 raft_consensus.cc:729] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5cbb3c3ee0459eb2f8b84e7efe3201, State: Initialized, Role: FOLLOWER
I20260808 05:06:28.925251 2991 raft_consensus.cc:348] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:28.925442 2991 raft_consensus.cc:374] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:06:28.925493 2991 raft_consensus.cc:729] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcda2fc386348ca91b9f266f825ff62, State: Initialized, Role: FOLLOWER
I20260808 05:06:28.925449 2990 consensus_queue.cc:260] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:28.925587 2991 consensus_queue.cc:260] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:28.925853 2783 heartbeater.cc:503] Master 127.11.70.254:34519 was elected leader, sending a full tablet report...
I20260808 05:06:28.925851 2991 ts_tablet_manager.cc:1428] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:06:28.925899 2970 heartbeater.cc:503] Master 127.11.70.254:34519 was elected leader, sending a full tablet report...
I20260808 05:06:28.925865 2990 ts_tablet_manager.cc:1428] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:06:28.934814 2996 raft_consensus.cc:482] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:06:28.934913 2996 raft_consensus.cc:504] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:28.935199 2996 leader_election.cc:288] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009), 53ca6ea72b2f409fa4086b44687863c6 (127.11.70.193:42733)
I20260808 05:06:28.938041 2977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.935350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:38009 (local address 127.11.70.195:60843)
0808 05:06:28.935506 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:28.935520 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:28.935582 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:28.935748 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:28.935749 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:28.935750 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:06:28.935817 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.935818 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.936459 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.936459 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.937169 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.937190 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.937769 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.937770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.937855 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.937858 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:06:28.937934 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:06:28.937973 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137}
I20260808 05:06:28.938040 2985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.935412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:60843 (local address 127.11.70.194:38009)
0808 05:06:28.935455 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.935458 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.935567 (+ 109us) server_negotiation.cc:407] Connection header received
0808 05:06:28.935636 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.935637 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.935646 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.935742 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:06:28.935917 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.936377 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.937307 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.937685 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.937772 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.937781 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.937943 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.937979 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:06:28.938205 2602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.935512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:47999 (local address 127.11.70.193:42733)
0808 05:06:28.935567 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.935569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.935693 (+ 124us) server_negotiation.cc:407] Connection header received
0808 05:06:28.935778 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.935780 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.935805 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.935888 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:06:28.936083 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.936561 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.937462 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.937868 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.937957 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.938031 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.938102 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.938141 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:06:28.938212 2998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.935441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42733 (local address 127.11.70.195:47999)
0808 05:06:28.935612 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:28.935621 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:28.935706 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:28.935919 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:28.935920 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:28.935922 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:06:28.936006 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.936007 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.936653 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.936654 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.937370 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:28.937372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.937957 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.937959 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:28.938029 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.938033 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:06:28.938095 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:06:28.938132 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":96,"threads_started":1}
I20260808 05:06:28.938578 2530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a78e8b8ca94b4da184a785edb6519d" candidate_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ca6ea72b2f409fa4086b44687863c6" is_pre_election: true
I20260808 05:06:28.938752 2530 raft_consensus.cc:2454] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5cbb3c3ee0459eb2f8b84e7efe3201 in term 0.
I20260808 05:06:28.938794 2717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a78e8b8ca94b4da184a785edb6519d" candidate_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcda2fc386348ca91b9f266f825ff62" is_pre_election: true
I20260808 05:06:28.938913 2717 raft_consensus.cc:2454] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5cbb3c3ee0459eb2f8b84e7efe3201 in term 0.
I20260808 05:06:28.939008 2809 leader_election.cc:302] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5cbb3c3ee0459eb2f8b84e7efe3201, 53ca6ea72b2f409fa4086b44687863c6; no voters:
I20260808 05:06:28.939138 2996 raft_consensus.cc:2781] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:06:28.939196 2996 raft_consensus.cc:482] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:06:28.939222 2996 raft_consensus.cc:3037] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:06:28.939873 2996 raft_consensus.cc:504] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:28.940003 2996 leader_election.cc:288] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [CANDIDATE]: Term 1 election: Requested vote from peers edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009), 53ca6ea72b2f409fa4086b44687863c6 (127.11.70.193:42733)
I20260808 05:06:28.940186 2530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a78e8b8ca94b4da184a785edb6519d" candidate_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53ca6ea72b2f409fa4086b44687863c6"
I20260808 05:06:28.940192 2717 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "96a78e8b8ca94b4da184a785edb6519d" candidate_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "edcda2fc386348ca91b9f266f825ff62"
I20260808 05:06:28.940272 2717 raft_consensus.cc:3037] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:06:28.940272 2530 raft_consensus.cc:3037] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:06:28.941128 2717 raft_consensus.cc:2454] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5cbb3c3ee0459eb2f8b84e7efe3201 in term 1.
I20260808 05:06:28.941267 2530 raft_consensus.cc:2454] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5cbb3c3ee0459eb2f8b84e7efe3201 in term 1.
I20260808 05:06:28.941314 2809 leader_election.cc:302] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5cbb3c3ee0459eb2f8b84e7efe3201, edcda2fc386348ca91b9f266f825ff62; no voters:
I20260808 05:06:28.941411 2996 raft_consensus.cc:2781] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:06:28.941576 2996 raft_consensus.cc:686] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 LEADER]: Becoming Leader. State: Replica: 4a5cbb3c3ee0459eb2f8b84e7efe3201, State: Running, Role: LEADER
I20260808 05:06:28.941671 2996 consensus_queue.cc:237] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:28.942422 2325 catalog_manager.cc:5495] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } health_report { overall_health: UNKNOWN } } }
I20260808 05:06:28.953663 2984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.951532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34224 (local address 127.11.70.195:42729)
0808 05:06:28.951598 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:28.951600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:28.951622 (+ 22us) server_negotiation.cc:407] Connection header received
0808 05:06:28.951653 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:28.951653 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:28.951669 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:28.951723 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:06:28.951863 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.952311 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.952986 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:28.953165 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:28.953220 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:28.953376 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:06:28.953468 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:06:28.953544 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:28.953563 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 05:06:28.953581 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:06:28.955479 2530 raft_consensus.cc:1261] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Refusing update from remote peer 4a5cbb3c3ee0459eb2f8b84e7efe3201: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:06:28.955534 2717 raft_consensus.cc:1261] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [term 1 FOLLOWER]: Refusing update from remote peer 4a5cbb3c3ee0459eb2f8b84e7efe3201: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:06:28.955942 2999 consensus_queue.cc:1035] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:06:28.956104 2996 consensus_queue.cc:1035] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [LEADER]: Connected to new peer: Peer: permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:06:28.958802 3002 mvcc.cc:205] Tried to move back new op lower bound from 7316134252359102464 to 7316134252305866752. Current Snapshot: MvccSnapshot[applied={T|T < 7316134252359102464}]
I20260808 05:06:28.959110 3003 mvcc.cc:205] Tried to move back new op lower bound from 7316134252359102464 to 7316134252305866752. Current Snapshot: MvccSnapshot[applied={T|T < 7316134252359102464}]
I20260808 05:06:28.961823 2325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:45392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:06:28.961935 2325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:45392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:06:28.962776 2325 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Sending DeleteTablet for 3 replicas of tablet 96a78e8b8ca94b4da184a785edb6519d
I20260808 05:06:28.963171 2496 tablet_service.cc:1514] Processing DeleteTablet for tablet 96a78e8b8ca94b4da184a785edb6519d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:06:28 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:36178
I20260808 05:06:28.963109 2878 tablet_service.cc:1514] Processing DeleteTablet for tablet 96a78e8b8ca94b4da184a785edb6519d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:06:28 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:34220
I20260808 05:06:28.963189 2684 tablet_service.cc:1514] Processing DeleteTablet for tablet 96a78e8b8ca94b4da184a785edb6519d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:06:28 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:50808
I20260808 05:06:28.963375 2605 tablet_replica.cc:330] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: stopping tablet replica
I20260808 05:06:28.963449 2605 raft_consensus.cc:2229] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:06:28.963541 2605 raft_consensus.cc:2258] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:06:28.963766 3020 tablet_replica.cc:330] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: stopping tablet replica
I20260808 05:06:28.963773 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 2383
I20260808 05:06:28.963908 3020 raft_consensus.cc:2229] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:06:28.964020 3020 raft_consensus.cc:2258] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:06:28.964187 3015 tablet_replica.cc:330] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: stopping tablet replica
I20260808 05:06:28.964270 3015 raft_consensus.cc:2229] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:06:28.964380 3015 raft_consensus.cc:2258] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:06:28.985129 3020 ts_tablet_manager.cc:1905] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:06:28.986925 3020 ts_tablet_manager.cc:1918] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:06:28.987012 3020 log.cc:1196] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/96a78e8b8ca94b4da184a785edb6519d
I20260808 05:06:28.987339 3020 ts_tablet_manager.cc:1939] T 96a78e8b8ca94b4da184a785edb6519d P edcda2fc386348ca91b9f266f825ff62: Deleting consensus metadata
I20260808 05:06:28.988190 2302 catalog_manager.cc:4841] TS edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009): tablet 96a78e8b8ca94b4da184a785edb6519d (table test-table [id=92ac10d4496d413db953ffdd86946f92]) successfully deleted
W20260808 05:06:28.993878 2302 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:42733 (error 108)
I20260808 05:06:28.994304 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 2599
I20260808 05:06:28.994483 2983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:28.994336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:42733 (local address 127.0.0.1:36186)
0808 05:06:28.994388 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:28.994421 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:42733: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:06:28.997095 3015 ts_tablet_manager.cc:1905] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:06:28.999409 3015 ts_tablet_manager.cc:1918] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:06:28.999567 3015 log.cc:1196] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/96a78e8b8ca94b4da184a785edb6519d
I20260808 05:06:28.999943 3015 ts_tablet_manager.cc:1939] T 96a78e8b8ca94b4da184a785edb6519d P 4a5cbb3c3ee0459eb2f8b84e7efe3201: Deleting consensus metadata
I20260808 05:06:29.001255 2304 catalog_manager.cc:4841] TS 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729): tablet 96a78e8b8ca94b4da184a785edb6519d (table test-table [id=92ac10d4496d413db953ffdd86946f92]) successfully deleted
W20260808 05:06:29.008945 2302 catalog_manager.cc:4584] TS 53ca6ea72b2f409fa4086b44687863c6 (127.11.70.193:42733): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 96a78e8b8ca94b4da184a785edb6519d: Network error: Client connection negotiation failed: client connection to 127.11.70.193:42733: connect: Connection refused (error 111)
I20260808 05:06:29.013964 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 2788
I20260808 05:06:29.025520 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 2280
I20260808 05:06:49.033358 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34519
--webserver_interface=127.11.70.254
--webserver_port=39659
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:34519
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:06:49.118810 3024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:49.119028 3024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:49.119052 3024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:49.120249 3024 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 05:06:49.120294 3024 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 05:06:49.120307 3024 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 05:06:49.120319 3024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:06:49.120332 3024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:49.120347 3024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:49.120359 3024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:06:49.120371 3024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:06:49.121932 3024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:34519
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34519
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=39659
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:49.122198 3024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:49.122485 3024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:49.128413 3032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:49.128477 3024 server_base.cc:1034] running on GCE node
W20260808 05:06:49.128440 3036 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:49.128461 3030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:49.128957 3024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:49.129309 3024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:49.130534 3024 hybrid_clock.cc:648] HybridClock initialized: now 1786165609130519 us; error 49 us; skew 500 ppm
Aug 08 05:06:49 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:49.138752 3024 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:06:49.139209 3024 webserver.cc:460] Webserver started at http://127.11.70.254:39659/ using document root <none> and password file <none>
I20260808 05:06:49.139477 3024 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:49.139549 3024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:49.140930 3024 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:49.141671 3044 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:49.141865 3024 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:49.141978 3024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "2fd827cb3db14ff883eca90c002df52a"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "197690460d3b570cff8f2458a51d73ae"
server_key_iv: "e75deae9fe8b3c87b12670b9d2b1b69c"
server_key_version: "encryptionkey@0"
I20260808 05:06:49.142339 3024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:49.162869 3024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:49.164849 3024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:49.165024 3024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:49.169521 3024 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:34519
I20260808 05:06:49.169559 3107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:34519 every 8 connection(s)
I20260808 05:06:49.169989 3024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:06:49.170152 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 3024
I20260808 05:06:49.170538 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:42733
--local_ip_for_outbound_sockets=127.11.70.193
--tserver_master_addrs=127.11.70.254:34519
--webserver_port=35513
--webserver_interface=127.11.70.193
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:06:49.172324 3110 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:06:49.173097 3110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Bootstrap starting.
I20260808 05:06:49.182616 3110 log.cc:824] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:49.184986 3110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:06:49.185350 3110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Bootstrap complete.
I20260808 05:06:49.187809 3110 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:49.188037 3110 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fd827cb3db14ff883eca90c002df52a, State: Initialized, Role: FOLLOWER
I20260808 05:06:49.188225 3110 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:49.188289 3110 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:06:49.188340 3110 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:06:49.188388 3110 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 2 FOLLOWER]: Advancing to term 3
I20260808 05:06:49.189410 3110 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:49.189502 3110 leader_election.cc:302] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fd827cb3db14ff883eca90c002df52a; no voters:
I20260808 05:06:49.189749 3110 leader_election.cc:288] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 05:06:49.189788 3114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 3 FOLLOWER]: Leader election won for term 3
I20260808 05:06:49.189930 3114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [term 3 LEADER]: Becoming Leader. State: Replica: 2fd827cb3db14ff883eca90c002df52a, State: Running, Role: LEADER
I20260808 05:06:49.190019 3114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } }
I20260808 05:06:49.190074 3110 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:06:49.190325 3120 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fd827cb3db14ff883eca90c002df52a. Latest consensus state: current_term: 3 leader_uuid: "2fd827cb3db14ff883eca90c002df52a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } } }
I20260808 05:06:49.190574 3120 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: This master's current role is: LEADER
I20260808 05:06:49.190512 3115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "2fd827cb3db14ff883eca90c002df52a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fd827cb3db14ff883eca90c002df52a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34519 } } }
I20260808 05:06:49.190876 3115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a [sys.catalog]: This master's current role is: LEADER
I20260808 05:06:49.191011 3127 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:06:49.191922 3127 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:06:49.192032 3127 catalog_manager.cc:1259] Loaded cluster ID: 2571484adf5f4187919f5aac06cf2421
I20260808 05:06:49.192070 3127 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:06:49.192958 3127 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:06:49.193174 3127 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Loaded TSK: 0
I20260808 05:06:49.193234 3127 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 2fd827cb3db14ff883eca90c002df52a: Loaded TSK: 1
F20260808 05:06:49.193470 3127 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f1102bd59ad google::LogMessage::Fail() at ??:0
@ 0x7f1102bd888a google::LogMessage::SendToLog() at ??:0
@ 0x7f1102bd54de google::LogMessage::Flush() at ??:0
@ 0x7f1102bd6a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f1105342104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f110533fd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f110ab2f1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f110ab2f48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f110ab2f594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f110aaf5c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f110aaffad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f1104aa30d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f1104a98954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f11058fc6db start_thread at ??:0
@ 0x7f11016d361f clone at ??:0
W20260808 05:06:49.279085 3112 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:49.279304 3112 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:49.279328 3112 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:49.280490 3112 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:49.280531 3112 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:49.280558 3112 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:06:49.282037 3112 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:42733
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=35513
--tserver_master_addrs=127.11.70.254:34519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3112
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:49.282303 3112 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:49.282614 3112 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:49.288800 3169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:49.288813 3168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:49.288828 3173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:49.289228 3112 server_base.cc:1034] running on GCE node
I20260808 05:06:49.289479 3112 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:49.289737 3112 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:49.290896 3112 hybrid_clock.cc:648] HybridClock initialized: now 1786165609290873 us; error 39 us; skew 500 ppm
Aug 08 05:06:49 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:49.293550 3112 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:06:49.294073 3112 webserver.cc:460] Webserver started at http://127.11.70.193:35513/ using document root <none> and password file <none>
I20260808 05:06:49.294340 3112 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:49.294389 3112 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:49.295856 3112 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:49.296586 3187 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:49.296785 3112 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:49.296906 3112 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "53ca6ea72b2f409fa4086b44687863c6"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "9ed12a4adc09d5ca4ba33db53ec9b425"
server_key_iv: "2625b6a95a88a0d2c302b7726982343f"
server_key_version: "encryptionkey@0"
I20260808 05:06:49.297422 3112 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:49.309213 3112 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:49.311770 3112 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:49.311939 3112 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:49.312235 3112 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:06:49.312791 3198 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:06:49.314314 3112 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:06:49.314379 3112 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 05:06:49.314414 3112 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:06:49.315416 3112 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:06:49.315464 3112 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 05:06:49.315550 3198 tablet_bootstrap.cc:492] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Bootstrap starting.
I20260808 05:06:49.323035 3112 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:42733
I20260808 05:06:49.323102 3357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:42733 every 8 connection(s)
I20260808 05:06:49.323498 3112 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:06:49.326762 3198 log.cc:824] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:06:49.328358 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 3112
I20260808 05:06:49.328701 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:38009
--local_ip_for_outbound_sockets=127.11.70.194
--tserver_master_addrs=127.11.70.254:34519
--webserver_port=39055
--webserver_interface=127.11.70.194
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:06:49.329404 3198 tablet_bootstrap.cc:492] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:06:49.329723 3198 tablet_bootstrap.cc:492] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Bootstrap complete.
I20260808 05:06:49.330993 3198 ts_tablet_manager.cc:1397] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.012s
I20260808 05:06:49.332027 3198 raft_consensus.cc:348] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:49.332276 3198 raft_consensus.cc:729] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53ca6ea72b2f409fa4086b44687863c6, State: Initialized, Role: FOLLOWER
I20260808 05:06:49.332460 3198 consensus_queue.cc:260] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:49.332772 3198 ts_tablet_manager.cc:1428] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260808 05:06:49.397619 3361 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:06:49.324228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:45061)
0808 05:06:49.324492 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:49.324546 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:49.325189 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:49.397409 (+ 72220us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":128,"threads_started":1}
W20260808 05:06:49.397912 3359 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:34519 (0 consecutive failures): Network error: Failed to ping master at 127.11.70.254:34519: Client connection negotiation failed: client connection to 127.11.70.254:34519: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 05:06:49.398329 3361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:49.398204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:41125)
0808 05:06:49.398265 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:49.398308 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 05:06:49.398828 3361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:49.398720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:52449)
0808 05:06:49.398769 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:49.398798 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 05:06:49.398959 3359 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:06:49.417692 3363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:49.417934 3363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:49.417976 3363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:49.419267 3363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:49.419337 3363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:49.419384 3363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:06:49.420835 3363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:38009
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=39055
--tserver_master_addrs=127.11.70.254:34519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:49.421114 3363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:49.421355 3363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:49.426594 3379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:49.426601 3375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:49.426601 3376 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:49.426819 3363 server_base.cc:1034] running on GCE node
I20260808 05:06:49.427034 3363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:49.427300 3363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:49.428465 3363 hybrid_clock.cc:648] HybridClock initialized: now 1786165609428456 us; error 41 us; skew 500 ppm
Aug 08 05:06:49 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:49.431048 3363 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:06:49.431479 3363 webserver.cc:460] Webserver started at http://127.11.70.194:39055/ using document root <none> and password file <none>
I20260808 05:06:49.431717 3363 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:49.431790 3363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:49.433149 3363 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:49.433787 3397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:49.433955 3363 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:06:49.434065 3363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "edcda2fc386348ca91b9f266f825ff62"
format_stamp: "Formatted at 2026-08-08 05:06:07 on dist-test-slave-7kzw"
server_key: "a3d4bb65f400b3e2bef1689f7af8fa19"
server_key_iv: "aa371c663275aecdcd23cca6131599bb"
server_key_version: "encryptionkey@0"
I20260808 05:06:49.434450 3363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:49.474502 3363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:49.476984 3363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:49.477164 3363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:49.477437 3363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:06:49.477787 3363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:06:49.477844 3363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:49.477886 3363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:06:49.477916 3363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:49.483930 3363 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:38009
I20260808 05:06:49.483980 3566 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:38009 every 8 connection(s)
I20260808 05:06:49.484377 3363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:06:49.485419 3571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:49.485035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:45115)
0808 05:06:49.485197 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:49.485273 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
W20260808 05:06:49.485855 3569 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:34519 (0 consecutive failures): Network error: Failed to ping master at 127.11.70.254:34519: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
I20260808 05:06:49.486150 3571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:49.486055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:39877)
0808 05:06:49.486102 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:49.486131 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:06:49.486582 3571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:49.486453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:52967)
0808 05:06:49.486539 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:49.486567 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
W20260808 05:06:49.486716 3569 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:06:49.487008 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 3363
I20260808 05:06:49.487334 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:42729
--local_ip_for_outbound_sockets=127.11.70.195
--tserver_master_addrs=127.11.70.254:34519
--webserver_port=34279
--webserver_interface=127.11.70.195
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:06:49.571730 3572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:06:49.571982 3572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:06:49.572021 3572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:06:49.573165 3572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:06:49.573236 3572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:06:49.573279 3572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:06:49.574826 3572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:42729
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=34279
--tserver_master_addrs=127.11.70.254:34519
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:06:49.575088 3572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:06:49.575330 3572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:06:49.580644 3579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:06:49.580696 3581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:49.580755 3572 server_base.cc:1034] running on GCE node
W20260808 05:06:49.580690 3578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:06:49.581022 3572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:06:49.581300 3572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:06:49.582502 3572 hybrid_clock.cc:648] HybridClock initialized: now 1786165609582464 us; error 38 us; skew 500 ppm
Aug 08 05:06:49 dist-test-slave-7kzw krb5kdc[1509](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:06:49.585219 3572 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:06:49.585665 3572 webserver.cc:460] Webserver started at http://127.11.70.195:34279/ using document root <none> and password file <none>
I20260808 05:06:49.585920 3572 fs_manager.cc:359] Metadata directory not provided
I20260808 05:06:49.585992 3572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:06:49.587409 3572 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:06:49.588035 3589 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:49.588210 3572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:06:49.588305 3572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201"
format_stamp: "Formatted at 2026-08-08 05:06:08 on dist-test-slave-7kzw"
server_key: "70a6b86c2087e88ecf9ae42a98df0bc6"
server_key_iv: "d3300a64423d37c4288d0a0b8c43f167"
server_key_version: "encryptionkey@0"
I20260808 05:06:49.588686 3572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:06:49.608847 3572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:06:49.611111 3572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:06:49.611274 3572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:06:49.611539 3572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:06:49.611876 3572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:06:49.611912 3572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:49.611934 3572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:06:49.611981 3572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:06:49.617933 3572 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:42729
I20260808 05:06:49.618026 3758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:42729 every 8 connection(s)
I20260808 05:06:49.618384 3572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:06:49.619494 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:49.619119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:50229)
0808 05:06:49.619279 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:49.619351 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
W20260808 05:06:49.619910 3759 heartbeater.cc:644] Failed to heartbeat to 127.11.70.254:34519 (0 consecutive failures): Network error: Failed to ping master at 127.11.70.254:34519: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
I20260808 05:06:49.620193 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:49.620094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:60307)
0808 05:06:49.620141 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:49.620174 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:06:49.620432 3761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:49.620383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:48977)
0808 05:06:49.620404 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:49.620421 (+ 17us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260808 05:06:49.620545 3759 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:06:49.623600 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 3572
I20260808 05:06:50.399624 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:50.399360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:48339)
0808 05:06:50.399514 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:50.399555 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":77,"threads_started":1}
I20260808 05:06:50.487324 3767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:50.487099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:47039)
0808 05:06:50.487219 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:50.487270 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":60,"threads_started":1}
I20260808 05:06:50.621063 3768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:50.620850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:50743)
0808 05:06:50.620978 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:50.621012 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260808 05:06:50.724282 3769 raft_consensus.cc:482] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:06:50.724423 3769 raft_consensus.cc:504] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:50.724884 3769 leader_election.cc:288] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729), edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009)
Aug 08 05:06:50 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.194@KRBTEST.COM
Aug 08 05:06:50 dist-test-slave-7kzw krb5kdc[1509](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165609, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.195@KRBTEST.COM
I20260808 05:06:50.735926 3776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:50.725248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:38989 (local address 127.11.70.195:42729)
0808 05:06:50.725410 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:50.725419 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:50.725449 (+ 30us) server_negotiation.cc:407] Connection header received
0808 05:06:50.725876 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:50.725878 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:50.725917 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:50.726070 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:50.726946 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:50.727799 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:50.728803 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:50.729196 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:50.729333 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:50.732106 (+ 2773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:50.732110 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:50.732111 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:50.732123 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:50.733980 (+ 1857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:50.734413 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:50.734415 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:50.734416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:50.734551 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:50.734843 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:50.734844 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:50.734844 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:50.735158 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:50.735253 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:50.735706 (+ 453us) server_negotiation.cc:299] Negotiation successful
0808 05:06:50.735842 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
I20260808 05:06:50.735956 3772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:50.725069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:38009 (local address 127.11.70.193:46863)
0808 05:06:50.725197 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:50.725208 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:50.725278 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:50.726158 (+ 880us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:50.726160 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:50.726619 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:06:50.726809 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:50.726815 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:50.727918 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:50.727919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:50.728672 (+ 753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:50.728674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:50.729274 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:50.729275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:50.729400 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:50.730044 (+ 644us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:06:50.730049 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:06:50.731613 (+ 1564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:06:50.733852 (+ 2239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:50.733859 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:50.733861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:50.734252 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:50.734572 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:50.734573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:50.734573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:50.734766 (+ 193us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:50.735300 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:06:50.735311 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:06:50.735483 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 05:06:50.735685 (+ 202us) client_negotiation.cc:240] Negotiation successful
0808 05:06:50.735831 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":4,"thread_start_us":69,"threads_started":1}
I20260808 05:06:50.736145 3764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:50.725033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:42729 (local address 127.11.70.193:38989)
0808 05:06:50.725095 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:50.725109 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:06:50.725171 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:06:50.726105 (+ 934us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:06:50.726108 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:06:50.726618 (+ 510us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:06:50.726809 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:50.726815 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:50.727911 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:50.727912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:50.728670 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:06:50.728674 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:06:50.729302 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:06:50.729304 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:06:50.729398 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:50.729996 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:06:50.730005 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:06:50.732005 (+ 2000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:06:50.734059 (+ 2054us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:50.734060 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:50.734060 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:50.734325 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:50.734613 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:06:50.734614 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:06:50.734614 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:06:50.734766 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:06:50.735300 (+ 534us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:06:50.735311 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:06:50.735483 (+ 172us) client_negotiation.cc:769] Sending connection context
0808 05:06:50.735616 (+ 133us) client_negotiation.cc:240] Negotiation successful
0808 05:06:50.735905 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":184}
I20260808 05:06:50.736392 3773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:50.725186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:46863 (local address 127.11.70.194:38009)
0808 05:06:50.725340 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:06:50.725353 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:06:50.725390 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:06:50.725868 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:06:50.725870 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:06:50.725921 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:06:50.726055 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:06:50.726929 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:50.727806 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:50.728764 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:06:50.729175 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:06:50.729301 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:06:50.731740 (+ 2439us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:06:50.731745 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:06:50.731745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:06:50.731758 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:06:50.733763 (+ 2005us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:50.734337 (+ 574us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:50.734339 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:50.734340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:50.734497 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:06:50.734844 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:06:50.734844 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:06:50.734845 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:06:50.735158 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:06:50.735268 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0808 05:06:50.736132 (+ 864us) server_negotiation.cc:299] Negotiation successful
0808 05:06:50.736284 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
W20260808 05:06:50.737150 3188 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
W20260808 05:06:50.737275 3191 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
I20260808 05:06:50.737330 3191 leader_election.cc:302] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53ca6ea72b2f409fa4086b44687863c6; no voters: 4a5cbb3c3ee0459eb2f8b84e7efe3201, edcda2fc386348ca91b9f266f825ff62
I20260808 05:06:50.737437 3769 raft_consensus.cc:2726] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:06:51.400381 3777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:51.400140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:57007)
0808 05:06:51.400288 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:51.400331 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":82,"threads_started":1}
I20260808 05:06:51.488029 3778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:51.487818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:47173)
0808 05:06:51.487948 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:51.487985 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260808 05:06:51.621768 3779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:51.621549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:55259)
0808 05:06:51.621687 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:51.621723 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":60,"threads_started":1}
I20260808 05:06:52.401206 3780 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:52.400919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:36917)
0808 05:06:52.401085 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:52.401130 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":69,"threads_started":1}
I20260808 05:06:52.429939 3781 raft_consensus.cc:482] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:06:52.430068 3781 raft_consensus.cc:504] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:52.430272 3781 leader_election.cc:288] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729), edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009)
W20260808 05:06:52.430800 3191 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
W20260808 05:06:52.430873 3188 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
I20260808 05:06:52.430970 3188 leader_election.cc:302] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53ca6ea72b2f409fa4086b44687863c6; no voters: 4a5cbb3c3ee0459eb2f8b84e7efe3201, edcda2fc386348ca91b9f266f825ff62
I20260808 05:06:52.431061 3781 raft_consensus.cc:2726] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:06:52.488955 3783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:52.488626 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:53709)
0808 05:06:52.488843 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:52.488889 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":193,"thread_start_us":70,"threads_started":1}
I20260808 05:06:52.622761 3784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:52.622394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:52475)
0808 05:06:52.622667 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:52.622712 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":252,"thread_start_us":150,"threads_started":1}
I20260808 05:06:53.402108 3785 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:53.401854 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:53111)
0808 05:06:53.401994 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:53.402056 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":70,"threads_started":1}
I20260808 05:06:53.489686 3786 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:53.489447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:49241)
0808 05:06:53.489599 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:53.489637 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":93,"threads_started":1}
I20260808 05:06:53.623546 3787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:53.623320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:43159)
0808 05:06:53.623454 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:53.623497 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":63,"threads_started":1}
I20260808 05:06:53.980383 3789 raft_consensus.cc:482] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:06:53.980501 3789 raft_consensus.cc:504] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:53.980671 3789 leader_election.cc:288] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729), edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009)
W20260808 05:06:53.981139 3191 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
W20260808 05:06:53.981288 3188 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
I20260808 05:06:53.981361 3188 leader_election.cc:302] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53ca6ea72b2f409fa4086b44687863c6; no voters: 4a5cbb3c3ee0459eb2f8b84e7efe3201, edcda2fc386348ca91b9f266f825ff62
I20260808 05:06:53.981437 3789 raft_consensus.cc:2726] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:06:54.402935 3792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:54.402710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:50059)
0808 05:06:54.402846 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:54.402886 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":87,"threads_started":1}
I20260808 05:06:54.490459 3793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:54.490199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:43923)
0808 05:06:54.490365 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:54.490409 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
I20260808 05:06:54.624421 3795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:54.624150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:46787)
0808 05:06:54.624310 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:54.624354 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260808 05:06:55.403666 3796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:55.403378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:33823)
0808 05:06:55.403539 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:55.403591 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":75,"threads_started":1}
I20260808 05:06:55.491206 3797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:55.490989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:36101)
0808 05:06:55.491120 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:55.491158 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260808 05:06:55.625257 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:55.624980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:35889)
0808 05:06:55.625172 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:55.625209 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":134,"threads_started":1}
I20260808 05:06:56.404444 3800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:56.404192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:57581)
0808 05:06:56.404355 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:56.404393 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":83,"threads_started":1}
I20260808 05:06:56.492105 3801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:56.491840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:34943)
0808 05:06:56.492010 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:56.492051 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":121,"threads_started":1}
I20260808 05:06:56.626093 3804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:56.625844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:40743)
0808 05:06:56.626002 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:56.626042 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":80,"threads_started":1}
I20260808 05:06:57.405185 3805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:57.404939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:35627)
0808 05:06:57.405077 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:57.405118 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":64,"threads_started":1}
I20260808 05:06:57.492931 3806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:57.492679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:45987)
0808 05:06:57.492836 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:57.492880 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":71,"threads_started":1}
I20260808 05:06:57.626938 3808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:57.626717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:36379)
0808 05:06:57.626848 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:57.626888 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260808 05:06:58.214224 3809 raft_consensus.cc:482] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:06:58.214371 3809 raft_consensus.cc:504] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:06:58.214622 3809 leader_election.cc:288] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729), edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009)
W20260808 05:06:58.215087 3188 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
W20260808 05:06:58.215219 3191 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
I20260808 05:06:58.215317 3191 leader_election.cc:302] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53ca6ea72b2f409fa4086b44687863c6; no voters: 4a5cbb3c3ee0459eb2f8b84e7efe3201, edcda2fc386348ca91b9f266f825ff62
I20260808 05:06:58.215392 3809 raft_consensus.cc:2726] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:06:58.405887 3811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:58.405654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:60009)
0808 05:06:58.405794 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:58.405836 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":70,"threads_started":1}
I20260808 05:06:58.493691 3812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:58.493404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:34815)
0808 05:06:58.493568 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:58.493621 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":82,"threads_started":1}
I20260808 05:06:58.627657 3813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:58.627426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:33333)
0808 05:06:58.627560 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:58.627606 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":76,"threads_started":1}
I20260808 05:06:59.406735 3814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:59.406446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:35003)
0808 05:06:59.406634 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:59.406681 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":121,"threads_started":1}
I20260808 05:06:59.494422 3815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:59.494176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:51405)
0808 05:06:59.494339 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:59.494374 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":108,"threads_started":1}
I20260808 05:06:59.628407 3817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:06:59.628161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:34941)
0808 05:06:59.628316 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 05:06:59.628354 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":79,"threads_started":1}
I20260808 05:07:00.407546 3818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:00.407278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:40515)
0808 05:07:00.407444 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:00.407494 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":65,"threads_started":1}
I20260808 05:07:00.495306 3819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:00.495066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:48171)
0808 05:07:00.495203 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:00.495253 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":68,"threads_started":1}
I20260808 05:07:00.629210 3820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:00.628923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:48857)
0808 05:07:00.629112 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:00.629156 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":69,"threads_started":1}
I20260808 05:07:01.322209 3821 raft_consensus.cc:482] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:07:01.322357 3821 raft_consensus.cc:504] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5cbb3c3ee0459eb2f8b84e7efe3201" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 42729 } } peers { permanent_uuid: "edcda2fc386348ca91b9f266f825ff62" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38009 } } peers { permanent_uuid: "53ca6ea72b2f409fa4086b44687863c6" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 42733 } }
I20260808 05:07:01.322613 3821 leader_election.cc:288] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729), edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009)
W20260808 05:07:01.323038 3191 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4a5cbb3c3ee0459eb2f8b84e7efe3201 (127.11.70.195:42729): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
W20260808 05:07:01.323161 3188 leader_election.cc:341] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer edcda2fc386348ca91b9f266f825ff62 (127.11.70.194:38009): Not found: Tablet not found: 96a78e8b8ca94b4da184a785edb6519d
I20260808 05:07:01.323262 3188 leader_election.cc:302] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53ca6ea72b2f409fa4086b44687863c6; no voters: 4a5cbb3c3ee0459eb2f8b84e7efe3201, edcda2fc386348ca91b9f266f825ff62
I20260808 05:07:01.323361 3821 raft_consensus.cc:2726] T 96a78e8b8ca94b4da184a785edb6519d P 53ca6ea72b2f409fa4086b44687863c6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:07:01.408360 3822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:01.408085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:41787)
0808 05:07:01.408250 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:01.408295 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":85,"threads_started":1}
I20260808 05:07:01.496093 3823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:01.495837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:36245)
0808 05:07:01.495995 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:01.496040 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":64,"threads_started":1}
I20260808 05:07:01.630132 3824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:01.629855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:51069)
0808 05:07:01.630035 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:01.630082 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":90,"threads_started":1}
I20260808 05:07:02.409296 3825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:02.409044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:36703)
0808 05:07:02.409204 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:02.409244 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":68,"threads_started":1}
I20260808 05:07:02.496891 3826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:02.496646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:60759)
0808 05:07:02.496797 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:02.496838 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":67,"threads_started":1}
I20260808 05:07:02.630846 3828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:02.630613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:54003)
0808 05:07:02.630748 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:02.630786 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
I20260808 05:07:03.410163 3829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:03.409857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:56475)
0808 05:07:03.410048 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:03.410096 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":104,"threads_started":1}
I20260808 05:07:03.497756 3830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:03.497460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:55817)
0808 05:07:03.497651 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:03.497701 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":111,"threads_started":1}
I20260808 05:07:03.631589 3832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:03.631367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:37609)
0808 05:07:03.631496 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:03.631537 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":64,"threads_started":1}
I20260808 05:07:04.411101 3833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:04.410844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.193:40743)
0808 05:07:04.411007 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:04.411051 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":69,"threads_started":1}
I20260808 05:07:04.498683 3834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:04.498392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.194:42127)
0808 05:07:04.498582 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:04.498626 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":112,"threads_started":1}
I20260808 05:07:04.626302 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 3112
I20260808 05:07:04.633280 3835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:04.632318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34519 (local address 127.11.70.195:35399)
0808 05:07:04.633172 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:04.633210 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.254:34519: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":835,"thread_start_us":656,"threads_started":1}
I20260808 05:07:04.639685 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 3363
I20260808 05:07:04.652585 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 3572
2026-08-08T05:07:04Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58681 ms)
[----------] 30 tests from SecurityITest (238424 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:04 dist-test-slave-7kzw krb5kdc[3842](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:04 dist-test-slave-7kzw krb5kdc[3842](info): set up 2 sockets
Aug 08 05:07:04 dist-test-slave-7kzw krb5kdc[3842](info): commencing operation
krb5kdc: starting...
W20260808 05:07:05.945041 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.267s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:06 dist-test-slave-7kzw krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:06.087802 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:45343
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:45581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:45343
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:06.172461 3861 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:06.172680 3861 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:06.172720 3861 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:06.173995 3861 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:06.174049 3861 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:06.174073 3861 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:06.174086 3861 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:06.174099 3861 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:06.175710 3861 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:45343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:45343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3861
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:06.175987 3861 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:06.176244 3861 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:07:06.181711 3861 server_base.cc:1034] running on GCE node
W20260808 05:07:06.181694 3873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:06.181670 3869 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:06.181679 3871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:06.182437 3861 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:06.182826 3861 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:06.184022 3861 hybrid_clock.cc:648] HybridClock initialized: now 1786165626184011 us; error 49 us; skew 500 ppm
Aug 08 05:07:06 dist-test-slave-7kzw krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165626, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:06.192090 3861 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:06.192574 3861 webserver.cc:460] Webserver started at http://127.11.70.254:41685/ using document root <none> and password file <none>
I20260808 05:07:06.192832 3861 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:06.192909 3861 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:06.193065 3861 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:06.194147 3861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "284ae6032e4c4f2ea41032b3b29e236d"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "fb687fb78bc13b30564d943748155341"
server_key_iv: "4a4bb5b569fef17bf415b70e63637208"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.194614 3861 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "284ae6032e4c4f2ea41032b3b29e236d"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "fb687fb78bc13b30564d943748155341"
server_key_iv: "4a4bb5b569fef17bf415b70e63637208"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.196045 3861 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:06.196873 3880 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.197074 3861 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:06.197180 3861 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "284ae6032e4c4f2ea41032b3b29e236d"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "fb687fb78bc13b30564d943748155341"
server_key_iv: "4a4bb5b569fef17bf415b70e63637208"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.197288 3861 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:06.215261 3861 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:06.217382 3861 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:06.217558 3861 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:06.221997 3861 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:45343
I20260808 05:07:06.222039 3949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:45343 every 8 connection(s)
I20260808 05:07:06.222433 3861 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:06.223459 3950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:06.223852 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 3861
I20260808 05:07:06.223949 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:06.224164 11547 external_mini_cluster.cc:1428] Setting key d142559da1eb111a7c67be1d623f796b
I20260808 05:07:06.226893 3950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d: Bootstrap starting.
I20260808 05:07:06.227630 3950 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:06.227990 3950 log.cc:824] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:06.228782 3950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d: No bootstrap required, opened a new log
Aug 08 05:07:06 dist-test-slave-7kzw krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165626, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:06.231769 3950 raft_consensus.cc:348] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284ae6032e4c4f2ea41032b3b29e236d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45343 } }
I20260808 05:07:06.231942 3950 raft_consensus.cc:374] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:06.231997 3950 raft_consensus.cc:729] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 284ae6032e4c4f2ea41032b3b29e236d, State: Initialized, Role: FOLLOWER
I20260808 05:07:06.232209 3950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284ae6032e4c4f2ea41032b3b29e236d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45343 } }
I20260808 05:07:06.232316 3950 raft_consensus.cc:388] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:06.232369 3950 raft_consensus.cc:482] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:06.232415 3950 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:06.233018 3950 raft_consensus.cc:504] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284ae6032e4c4f2ea41032b3b29e236d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45343 } }
I20260808 05:07:06.233157 3950 leader_election.cc:302] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 284ae6032e4c4f2ea41032b3b29e236d; no voters:
I20260808 05:07:06.233367 3950 leader_election.cc:288] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:06.233405 3957 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:06.233628 3957 raft_consensus.cc:686] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [term 1 LEADER]: Becoming Leader. State: Replica: 284ae6032e4c4f2ea41032b3b29e236d, State: Running, Role: LEADER
I20260808 05:07:06.233695 3950 sys_catalog.cc:564] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:06.233767 3957 consensus_queue.cc:237] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284ae6032e4c4f2ea41032b3b29e236d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45343 } }
I20260808 05:07:06.234196 3957 sys_catalog.cc:455] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 284ae6032e4c4f2ea41032b3b29e236d. Latest consensus state: current_term: 1 leader_uuid: "284ae6032e4c4f2ea41032b3b29e236d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284ae6032e4c4f2ea41032b3b29e236d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45343 } } }
I20260808 05:07:06.234454 3957 sys_catalog.cc:458] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:06.234378 3963 sys_catalog.cc:455] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "284ae6032e4c4f2ea41032b3b29e236d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "284ae6032e4c4f2ea41032b3b29e236d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45343 } } }
I20260808 05:07:06.234917 3963 sys_catalog.cc:458] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:06.234930 3973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:06.235809 3973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:06.236456 3955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.224702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42372 (local address 127.11.70.254:45343)
0808 05:07:06.224910 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:06.224917 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:06.224944 (+ 27us) server_negotiation.cc:407] Connection header received
0808 05:07:06.225385 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:06.225391 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:06.225438 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:06.225554 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:06.226449 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.227431 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.228576 (+ 1145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.229031 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.229122 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.231953 (+ 2831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:06.231956 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:06.231957 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:06.231985 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:06.234370 (+ 2385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.234921 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.234924 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.234925 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.235076 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.235317 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.235318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.235319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.235639 (+ 320us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:06.235782 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:06.236075 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 05:07:06.236222 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":120,"threads_started":1}
I20260808 05:07:06.237877 3973 catalog_manager.cc:1347] Generated new cluster ID: d8ff00fcc44f41d6b20e513d6f76b76e
I20260808 05:07:06.237932 3973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:06.245941 3973 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:06.246519 3973 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:06.256898 3973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d: Generated new TSK 0
I20260808 05:07:06.257112 3973 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:07:06.285811 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45343
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:45581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:06.371738 3988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:06.371955 3988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:06.371979 3988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:06.373170 3988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:06.373287 3988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:06.373349 3988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:07:06.374895 3988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:06.375164 3988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:06.375406 3988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:06.381024 4003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:06.381078 3988 server_base.cc:1034] running on GCE node
W20260808 05:07:06.381038 4000 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:06.381042 3996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:06.381544 3988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:06.381850 3988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:06.382997 3988 hybrid_clock.cc:648] HybridClock initialized: now 1786165626382982 us; error 30 us; skew 500 ppm
Aug 08 05:07:06 dist-test-slave-7kzw krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165626, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:06.385645 3988 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:07:06.386132 3988 webserver.cc:460] Webserver started at http://127.11.70.193:45977/ using document root <none> and password file <none>
I20260808 05:07:06.386368 3988 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:06.386440 3988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:06.386606 3988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:06.387704 3988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "d5b33a861c634df298694943523779f1"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "04c83345e224d74e068764c5cd61222c"
server_key_iv: "b14abfbe7337f5fd75231154620044f3"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.388085 3988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "d5b33a861c634df298694943523779f1"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "04c83345e224d74e068764c5cd61222c"
server_key_iv: "b14abfbe7337f5fd75231154620044f3"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.389429 3988 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:06.390166 4011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.390352 3988 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:07:06.390499 3988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "d5b33a861c634df298694943523779f1"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "04c83345e224d74e068764c5cd61222c"
server_key_iv: "b14abfbe7337f5fd75231154620044f3"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.390592 3988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:06.417968 3988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:06.420557 3988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:06.420735 3988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:06.421003 3988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:06.421350 3988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:06.421437 3988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.421483 3988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:06.421509 3988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.427907 3988 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:34541
I20260808 05:07:06.427970 4166 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:34541 every 8 connection(s)
I20260808 05:07:06.428305 3988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:07:06.432097 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 3988
I20260808 05:07:06.432212 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:07:06.432415 11547 external_mini_cluster.cc:1428] Setting key 2ee2196fc80efd642cad4eefe74b0806
Aug 08 05:07:06 dist-test-slave-7kzw krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165626, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:06.439697 4170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.429056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:45343 (local address 127.11.70.193:51731)
0808 05:07:06.429217 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:06.429268 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:06.429760 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:06.430083 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:06.430087 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:06.430704 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:06.430902 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.430906 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.431668 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.431668 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.432826 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.432829 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.433341 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.433342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.433501 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.434186 (+ 685us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:06.434197 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:06.436229 (+ 2032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:06.438227 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:06.438235 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:06.438238 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:06.438526 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:06.438771 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:06.438771 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:06.438772 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:06.438877 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:06.439197 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:06.439203 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:06.439321 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 05:07:06.439399 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:07:06.439526 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":86,"threads_started":1}
I20260808 05:07:06.439697 3955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.429107 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:51731 (local address 127.11.70.254:45343)
0808 05:07:06.429189 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:06.429191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:06.429367 (+ 176us) server_negotiation.cc:407] Connection header received
0808 05:07:06.429914 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:06.429915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:06.429928 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:06.430012 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:06.431012 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.431578 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.432936 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.433264 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.433328 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.436332 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:06.436334 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:06.436334 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:06.436343 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:06.438132 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.438612 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.438613 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.438614 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.438692 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.438959 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.438960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.438960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.439129 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:06.439205 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:06.439469 (+ 264us) server_negotiation.cc:299] Negotiation successful
0808 05:07:06.439570 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:07:06.440266 4167 heartbeater.cc:347] Connected to a master server at 127.11.70.254:45343
I20260808 05:07:06.440390 4167 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:06.440580 4167 heartbeater.cc:511] Master 127.11.70.254:45343 requested a full tablet report, sending...
I20260808 05:07:06.441143 3904 ts_manager.cc:194] Registered new tserver with Master: d5b33a861c634df298694943523779f1 (127.11.70.193:34541)
I20260808 05:07:06.441792 3904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:51731
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:07:06.463613 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45343
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:45581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:06.551793 4173 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:06.552024 4173 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:06.552052 4173 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:06.553239 4173 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:06.553292 4173 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:06.553320 4173 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:07:06.554929 4173 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4173
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:06.555203 4173 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:06.555464 4173 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:06.560990 4181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:06.560981 4186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:06.561239 4173 server_base.cc:1034] running on GCE node
W20260808 05:07:06.560983 4183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:06.561551 4173 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:06.561825 4173 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:06.563001 4173 hybrid_clock.cc:648] HybridClock initialized: now 1786165626562987 us; error 62 us; skew 500 ppm
Aug 08 05:07:06 dist-test-slave-7kzw krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165626, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:06.565727 4173 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:07:06.566200 4173 webserver.cc:460] Webserver started at http://127.11.70.194:41961/ using document root <none> and password file <none>
I20260808 05:07:06.566435 4173 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:06.566532 4173 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:06.566695 4173 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:06.567787 4173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "8da5970150464b8495a0b467f8b0e212"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "91c587645dd74e3f58268d30e28a796a"
server_key_iv: "5e475cee352cd70f68fc54deb538c789"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.568159 4173 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "8da5970150464b8495a0b467f8b0e212"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "91c587645dd74e3f58268d30e28a796a"
server_key_iv: "5e475cee352cd70f68fc54deb538c789"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.569558 4173 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:06.570353 4195 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.570592 4173 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:06.570730 4173 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "8da5970150464b8495a0b467f8b0e212"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "91c587645dd74e3f58268d30e28a796a"
server_key_iv: "5e475cee352cd70f68fc54deb538c789"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.570812 4173 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:06.580852 4173 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:06.582985 4173 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:06.583164 4173 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:06.583423 4173 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:06.583767 4173 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:06.583829 4173 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.583878 4173 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:06.583910 4173 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.590269 4173 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:42029
I20260808 05:07:06.590317 4354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:42029 every 8 connection(s)
I20260808 05:07:06.590756 4173 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:07:06 dist-test-slave-7kzw krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165626, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:06.600543 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 4173
I20260808 05:07:06.600735 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:07:06.600835 3955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.591565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:43867 (local address 127.11.70.254:45343)
0808 05:07:06.591636 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:06.591638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:06.591850 (+ 212us) server_negotiation.cc:407] Connection header received
0808 05:07:06.592374 (+ 524us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:06.592375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:06.592386 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:06.592447 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:06.593604 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.594113 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.595262 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.595461 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.595563 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.597823 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:06.597824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:06.597824 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:06.597831 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:06.599224 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.599829 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.599830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.599831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.599898 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.600167 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.600168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.600168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.600275 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:06.600326 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:06.600591 (+ 265us) server_negotiation.cc:299] Negotiation successful
0808 05:07:06.600741 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:07:06.600983 4360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.591548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:45343 (local address 127.11.70.194:43867)
0808 05:07:06.591713 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:06.591759 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:06.592277 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:06.592502 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:06.592505 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:06.593159 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:06.593459 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.593465 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.594214 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.594215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.595175 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.595178 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.595573 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.595575 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.595688 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.596185 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:06.596194 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:06.597723 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:06.599307 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:06.599314 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:06.599316 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:06.599749 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:06.599966 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:06.599966 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:06.599967 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:06.600075 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:06.600330 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:06.600336 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:06.600452 (+ 116us) client_negotiation.cc:769] Sending connection context
0808 05:07:06.600564 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 05:07:06.600734 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260808 05:07:06.601011 11547 external_mini_cluster.cc:1428] Setting key bbefad4e77fd6415720ca71ac8a05340
I20260808 05:07:06.601438 4355 heartbeater.cc:347] Connected to a master server at 127.11.70.254:45343
I20260808 05:07:06.601532 4355 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:06.601729 4355 heartbeater.cc:511] Master 127.11.70.254:45343 requested a full tablet report, sending...
I20260808 05:07:06.602159 3904 ts_manager.cc:194] Registered new tserver with Master: 8da5970150464b8495a0b467f8b0e212 (127.11.70.194:42029)
I20260808 05:07:06.602607 3904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:43867
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:07:06.631475 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45343
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:45581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:06.717396 4364 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:06.717607 4364 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:06.717630 4364 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:06.718833 4364 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:06.718875 4364 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:06.718902 4364 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:07:06.720377 4364 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:45343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4364
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:06.720574 4364 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:06.720754 4364 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:07:06.726174 4364 server_base.cc:1034] running on GCE node
W20260808 05:07:06.726135 4374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:06.726148 4372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:06.726155 4370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:06.726742 4364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:06.727075 4364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:06.728255 4364 hybrid_clock.cc:648] HybridClock initialized: now 1786165626728230 us; error 49 us; skew 500 ppm
Aug 08 05:07:06 dist-test-slave-7kzw krb5kdc[3842](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165626, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:06.730795 4364 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:07:06.731304 4364 webserver.cc:460] Webserver started at http://127.11.70.195:46815/ using document root <none> and password file <none>
I20260808 05:07:06.731549 4364 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:06.731619 4364 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:06.731760 4364 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:06.732810 4364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "75e1eec0215f475e8e1303dbeddb3329"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "298326befa73b0f005468e034382bcab"
server_key_iv: "dec324f84f8b867ef1c4edc42c7f5b2d"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.733271 4364 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "75e1eec0215f475e8e1303dbeddb3329"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "298326befa73b0f005468e034382bcab"
server_key_iv: "dec324f84f8b867ef1c4edc42c7f5b2d"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.734970 4364 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:06.736074 4384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.736274 4364 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:06.736393 4364 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "75e1eec0215f475e8e1303dbeddb3329"
format_stamp: "Formatted at 2026-08-08 05:07:06 on dist-test-slave-7kzw"
server_key: "298326befa73b0f005468e034382bcab"
server_key_iv: "dec324f84f8b867ef1c4edc42c7f5b2d"
server_key_version: "encryptionkey@0"
I20260808 05:07:06.736488 4364 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:06.753264 4364 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:06.755381 4364 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:06.755568 4364 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:06.755829 4364 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:06.756249 4364 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:06.756313 4364 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.756363 4364 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:06.756394 4364 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:06.763609 4364 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:35331
I20260808 05:07:06.763665 4552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:35331 every 8 connection(s)
I20260808 05:07:06.763998 4364 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:07:06.767904 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 4364
I20260808 05:07:06.768018 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:07:06.768186 11547 external_mini_cluster.cc:1428] Setting key 03a90c94d0599ada2f6ca42969a89681
Aug 08 05:07:06 dist-test-slave-7kzw krb5kdc[3842](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165626, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:06.773757 3955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.764690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:56253 (local address 127.11.70.254:45343)
0808 05:07:06.764739 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:06.764741 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:06.764957 (+ 216us) server_negotiation.cc:407] Connection header received
0808 05:07:06.765505 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:06.765507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:06.765520 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:06.765598 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:06.766588 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.767160 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.768476 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.768862 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.768933 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.771249 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:06.771250 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:06.771251 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:06.771258 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:06.772502 (+ 1244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.772879 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.772880 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.772881 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.772933 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.773148 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.773148 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.773149 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.773248 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:06.773297 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:06.773590 (+ 293us) server_negotiation.cc:299] Negotiation successful
0808 05:07:06.773681 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:07:06.773967 4556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.764651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:45343 (local address 127.11.70.195:56253)
0808 05:07:06.764841 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:06.764883 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:06.765382 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:06.765671 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:06.765675 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:06.766260 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:06.766454 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.766459 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.767263 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.767264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.768352 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.768355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.768956 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.768957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.769135 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.769704 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:06.769722 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:06.771159 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:06.772579 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:06.772586 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:06.772587 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:06.772813 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:06.772993 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:06.772993 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:06.772994 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:06.773093 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:06.773302 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:06.773306 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:06.773438 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 05:07:06.773519 (+ 81us) client_negotiation.cc:240] Negotiation successful
0808 05:07:06.773700 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":81,"threads_started":1}
I20260808 05:07:06.774435 4554 heartbeater.cc:347] Connected to a master server at 127.11.70.254:45343
I20260808 05:07:06.774570 4554 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:06.774783 4554 heartbeater.cc:511] Master 127.11.70.254:45343 requested a full tablet report, sending...
I20260808 05:07:06.775166 3904 ts_manager.cc:194] Registered new tserver with Master: 75e1eec0215f475e8e1303dbeddb3329 (127.11.70.195:35331)
I20260808 05:07:06.775535 3904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:56253
I20260808 05:07:06.779799 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:07:06.786643 3955 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.781143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42388 (local address 127.11.70.254:45343)
0808 05:07:06.781212 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:06.781214 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:06.781298 (+ 84us) server_negotiation.cc:407] Connection header received
0808 05:07:06.781335 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:06.781336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:06.781344 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:06.781395 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:06.781894 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.782342 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.783073 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.783252 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.783305 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.784361 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:06.784363 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:06.784363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:06.784370 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:06.785645 (+ 1275us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.785951 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.785952 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.785952 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.786005 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:06.786173 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:06.786173 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:06.786173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:06.786308 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:06.786382 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:06.786520 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 05:07:06.786583 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:07:06.788125 3904 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42388:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:07:06.789682 3904 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:07:06.796501 4574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.792048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:35331 (local address 127.0.0.1:58118)
0808 05:07:06.792433 (+ 385us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:06.792444 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:06.792516 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:06.792716 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:06.792717 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:06.792720 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:06.792809 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.792812 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.794241 (+ 1429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.794242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.795372 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.795374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.796230 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.796231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.796293 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.796305 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 05:07:06.796363 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:07:06.796400 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":361,"mutex_wait_us":86,"thread_start_us":46,"threads_started":1}
I20260808 05:07:06.796512 4578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.792255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58118 (local address 127.11.70.195:35331)
0808 05:07:06.792455 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:06.792463 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:06.792511 (+ 48us) server_negotiation.cc:407] Connection header received
0808 05:07:06.792590 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:06.792592 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:06.792624 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:06.793034 (+ 410us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:06.793108 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.794128 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.795463 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.796139 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.796233 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.796292 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:06.796377 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 05:07:06.796424 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":85,"threads_started":1}
I20260808 05:07:06.796801 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.792255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50742 (local address 127.11.70.193:34541)
0808 05:07:06.792539 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:06.792543 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:06.792554 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:07:06.792595 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:06.792597 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:06.792611 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:06.792749 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:06.792884 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.794095 (+ 1211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.795698 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.796374 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.796443 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.796494 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:06.796664 (+ 170us) server_negotiation.cc:299] Negotiation successful
0808 05:07:06.796714 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":249,"thread_start_us":82,"threads_started":1}
I20260808 05:07:06.797052 4571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.792048 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:34541 (local address 127.0.0.1:50742)
0808 05:07:06.792320 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:06.792363 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:06.792435 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:06.792713 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:06.792716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:06.792718 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:06.792797 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.792800 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.794207 (+ 1407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.794208 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.795597 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.795598 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.796461 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.796462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.796520 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.796524 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:07:06.796576 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:07:06.796989 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":237,"mutex_wait_us":72,"thread_start_us":106,"threads_started":1}
I20260808 05:07:06.797318 4459 tablet_service.cc:1467] Processing CreateTablet for tablet e841d284f08843e19767a5e0ec443ce1 (DEFAULT_TABLE table=test-table [id=d50d7f506b8440018120b99293295113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:06.797664 4459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e841d284f08843e19767a5e0ec443ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:06.797742 4075 tablet_service.cc:1467] Processing CreateTablet for tablet e841d284f08843e19767a5e0ec443ce1 (DEFAULT_TABLE table=test-table [id=d50d7f506b8440018120b99293295113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:06.798092 4075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e841d284f08843e19767a5e0ec443ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:06.798136 4570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.792065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:42029 (local address 127.0.0.1:51498)
0808 05:07:06.792552 (+ 487us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:06.792561 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:06.792599 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:06.793097 (+ 498us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:06.793098 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:06.793100 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:06.793143 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.793145 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.794277 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.794278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.795595 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:06.795598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.797880 (+ 2282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.797882 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:06.797946 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.797951 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:07:06.798015 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 05:07:06.798059 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":474,"mutex_wait_us":109,"thread_start_us":92,"threads_started":1}
I20260808 05:07:06.798164 4579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:06.792306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51498 (local address 127.11.70.194:42029)
0808 05:07:06.792941 (+ 635us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:06.792945 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:06.792954 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:06.792997 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:06.792998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:06.793010 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:06.793097 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:06.793203 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.794149 (+ 946us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.796534 (+ 2385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:06.797781 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:06.797859 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:06.797914 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:06.798028 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 05:07:06.798074 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":103,"threads_started":1}
I20260808 05:07:06.800740 4580 tablet_bootstrap.cc:492] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: Bootstrap starting.
I20260808 05:07:06.801096 4263 tablet_service.cc:1467] Processing CreateTablet for tablet e841d284f08843e19767a5e0ec443ce1 (DEFAULT_TABLE table=test-table [id=d50d7f506b8440018120b99293295113]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:06.801446 4263 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e841d284f08843e19767a5e0ec443ce1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:06.801616 4580 tablet_bootstrap.cc:654] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:06.802125 4580 log.cc:824] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:06.802690 4582 tablet_bootstrap.cc:492] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1: Bootstrap starting.
I20260808 05:07:06.802943 4580 tablet_bootstrap.cc:492] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: No bootstrap required, opened a new log
I20260808 05:07:06.803030 4580 ts_tablet_manager.cc:1397] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:06.803396 4582 tablet_bootstrap.cc:654] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:06.803964 4582 log.cc:824] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:06.804764 4586 tablet_bootstrap.cc:492] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: Bootstrap starting.
I20260808 05:07:06.804802 4582 tablet_bootstrap.cc:492] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1: No bootstrap required, opened a new log
I20260808 05:07:06.804868 4582 ts_tablet_manager.cc:1397] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:06.805224 4580 raft_consensus.cc:348] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } }
I20260808 05:07:06.805420 4580 raft_consensus.cc:374] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:06.805466 4580 raft_consensus.cc:729] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75e1eec0215f475e8e1303dbeddb3329, State: Initialized, Role: FOLLOWER
I20260808 05:07:06.805502 4586 tablet_bootstrap.cc:654] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:06.805625 4580 consensus_queue.cc:260] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } }
I20260808 05:07:06.805980 4554 heartbeater.cc:503] Master 127.11.70.254:45343 was elected leader, sending a full tablet report...
I20260808 05:07:06.805982 4580 ts_tablet_manager.cc:1428] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:06.806089 4586 log.cc:824] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:06.806823 4582 raft_consensus.cc:348] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } }
I20260808 05:07:06.806998 4582 raft_consensus.cc:374] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:06.807052 4582 raft_consensus.cc:729] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5b33a861c634df298694943523779f1, State: Initialized, Role: FOLLOWER
I20260808 05:07:06.807044 4586 tablet_bootstrap.cc:492] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: No bootstrap required, opened a new log
I20260808 05:07:06.807132 4586 ts_tablet_manager.cc:1397] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:06.807221 4582 consensus_queue.cc:260] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } }
I20260808 05:07:06.807574 4582 ts_tablet_manager.cc:1428] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:07:06.807580 4167 heartbeater.cc:503] Master 127.11.70.254:45343 was elected leader, sending a full tablet report...
I20260808 05:07:06.809018 4586 raft_consensus.cc:348] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } }
I20260808 05:07:06.809154 4586 raft_consensus.cc:374] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:06.809176 4586 raft_consensus.cc:729] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8da5970150464b8495a0b467f8b0e212, State: Initialized, Role: FOLLOWER
I20260808 05:07:06.809312 4586 consensus_queue.cc:260] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } }
I20260808 05:07:06.809574 4586 ts_tablet_manager.cc:1428] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:06.809654 4355 heartbeater.cc:503] Master 127.11.70.254:45343 was elected leader, sending a full tablet report...
W20260808 05:07:06.841372 4359 tablet.cc:2369] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:07:06.929091 4169 tablet.cc:2369] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:07:07.014717 4555 tablet.cc:2369] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:07:07.184507 4590 raft_consensus.cc:482] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:07:07.184659 4590 raft_consensus.cc:504] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } }
I20260808 05:07:07.185173 4590 leader_election.cc:288] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75e1eec0215f475e8e1303dbeddb3329 (127.11.70.195:35331), d5b33a861c634df298694943523779f1 (127.11.70.193:34541)
I20260808 05:07:07.189304 4578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.185499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:44275 (local address 127.11.70.195:35331)
0808 05:07:07.185551 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.185553 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.185665 (+ 112us) server_negotiation.cc:407] Connection header received
0808 05:07:07.185700 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.185701 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.185711 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.185765 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:07.186010 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.186827 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.188341 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.188928 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.188993 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.189001 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.189184 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.189225 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:07:07.189304 4577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.185544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:46493 (local address 127.11.70.193:34541)
0808 05:07:07.185607 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.185609 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.185623 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:07:07.185685 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.185686 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.185699 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.185765 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:07.185997 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.186795 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.188340 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.188896 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.188983 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.188994 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.189182 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.189225 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:07:07.189335 4592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.185399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:34541 (local address 127.11.70.194:46493)
0808 05:07:07.185553 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:07.185561 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:07.185616 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:07.185811 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:07.185811 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:07.185813 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:07.185899 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.185901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.186894 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.186895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.188219 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.188222 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.189006 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.189007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.189093 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.189100 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 05:07:07.189160 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:07:07.189222 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":2,"thread_start_us":86,"threads_started":1}
I20260808 05:07:07.189335 4591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.185384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:35331 (local address 127.11.70.194:44275)
0808 05:07:07.185538 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:07.185552 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:07.185620 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:07.185806 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:07.185807 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:07.185809 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:07.185899 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.185903 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.186900 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.186901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.188218 (+ 1317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.188222 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.189009 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.189009 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.189093 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.189101 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 05:07:07.189160 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:07:07.189222 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":134,"thread_start_us":85,"threads_started":1}
I20260808 05:07:07.189944 4104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e841d284f08843e19767a5e0ec443ce1" candidate_uuid: "8da5970150464b8495a0b467f8b0e212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b33a861c634df298694943523779f1" is_pre_election: true
I20260808 05:07:07.189985 4490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e841d284f08843e19767a5e0ec443ce1" candidate_uuid: "8da5970150464b8495a0b467f8b0e212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75e1eec0215f475e8e1303dbeddb3329" is_pre_election: true
I20260808 05:07:07.190138 4490 raft_consensus.cc:2454] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8da5970150464b8495a0b467f8b0e212 in term 0.
I20260808 05:07:07.190161 4104 raft_consensus.cc:2454] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8da5970150464b8495a0b467f8b0e212 in term 0.
I20260808 05:07:07.190404 4198 leader_election.cc:302] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75e1eec0215f475e8e1303dbeddb3329, 8da5970150464b8495a0b467f8b0e212; no voters:
I20260808 05:07:07.190608 4590 raft_consensus.cc:2781] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:07:07.190672 4590 raft_consensus.cc:482] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:07:07.190701 4590 raft_consensus.cc:3037] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:07.191504 4590 raft_consensus.cc:504] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } }
I20260808 05:07:07.191664 4590 leader_election.cc:288] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [CANDIDATE]: Term 1 election: Requested vote from peers 75e1eec0215f475e8e1303dbeddb3329 (127.11.70.195:35331), d5b33a861c634df298694943523779f1 (127.11.70.193:34541)
I20260808 05:07:07.191872 4490 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e841d284f08843e19767a5e0ec443ce1" candidate_uuid: "8da5970150464b8495a0b467f8b0e212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75e1eec0215f475e8e1303dbeddb3329"
I20260808 05:07:07.191920 4104 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e841d284f08843e19767a5e0ec443ce1" candidate_uuid: "8da5970150464b8495a0b467f8b0e212" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5b33a861c634df298694943523779f1"
I20260808 05:07:07.191985 4490 raft_consensus.cc:3037] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:07.192000 4104 raft_consensus.cc:3037] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:07.193023 4104 raft_consensus.cc:2454] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8da5970150464b8495a0b467f8b0e212 in term 1.
I20260808 05:07:07.193023 4490 raft_consensus.cc:2454] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8da5970150464b8495a0b467f8b0e212 in term 1.
I20260808 05:07:07.193212 4198 leader_election.cc:302] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75e1eec0215f475e8e1303dbeddb3329, 8da5970150464b8495a0b467f8b0e212; no voters:
I20260808 05:07:07.193338 4590 raft_consensus.cc:2781] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:07.193531 4590 raft_consensus.cc:686] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 1 LEADER]: Becoming Leader. State: Replica: 8da5970150464b8495a0b467f8b0e212, State: Running, Role: LEADER
I20260808 05:07:07.193674 4590 consensus_queue.cc:237] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } }
I20260808 05:07:07.194661 3904 catalog_manager.cc:5495] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8da5970150464b8495a0b467f8b0e212 (127.11.70.194). New cstate: current_term: 1 leader_uuid: "8da5970150464b8495a0b467f8b0e212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8da5970150464b8495a0b467f8b0e212" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42029 } health_report { overall_health: HEALTHY } } }
I20260808 05:07:07.237097 4579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.234410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51508 (local address 127.11.70.194:42029)
0808 05:07:07.234498 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.234500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.234508 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:07:07.234657 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.234658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.234684 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.234757 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:07.234961 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.235446 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.236381 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.236570 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.236627 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.236769 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:07.236870 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:07.236934 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.236969 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.236986 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260808 05:07:07.239022 4490 raft_consensus.cc:1261] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [term 1 FOLLOWER]: Refusing update from remote peer 8da5970150464b8495a0b467f8b0e212: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:07.239050 4104 raft_consensus.cc:1261] T e841d284f08843e19767a5e0ec443ce1 P d5b33a861c634df298694943523779f1 [term 1 FOLLOWER]: Refusing update from remote peer 8da5970150464b8495a0b467f8b0e212: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:07.239452 4593 consensus_queue.cc:1035] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75e1eec0215f475e8e1303dbeddb3329" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:07.239603 4590 consensus_queue.cc:1035] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5b33a861c634df298694943523779f1" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 34541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:07.242969 4597 mvcc.cc:205] Tried to move back new op lower bound from 7316134409168089088 to 7316134408986136576. Current Snapshot: MvccSnapshot[applied={T|T < 7316134409168089088}]
I20260808 05:07:07.243218 4598 mvcc.cc:205] Tried to move back new op lower bound from 7316134409168089088 to 7316134408986136576. Current Snapshot: MvccSnapshot[applied={T|T < 7316134409168089088 or (T in {7316134409168089088})}]
I20260808 05:07:07.244170 3904 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:07.244253 3904 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42388:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:07.245026 3904 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 284ae6032e4c4f2ea41032b3b29e236d: Sending DeleteTablet for 3 replicas of tablet e841d284f08843e19767a5e0ec443ce1
I20260808 05:07:07.245362 4263 tablet_service.cc:1514] Processing DeleteTablet for tablet e841d284f08843e19767a5e0ec443ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:07 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:51498
I20260808 05:07:07.245419 4459 tablet_service.cc:1514] Processing DeleteTablet for tablet e841d284f08843e19767a5e0ec443ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:07 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:58118
I20260808 05:07:07.245450 4075 tablet_service.cc:1514] Processing DeleteTablet for tablet e841d284f08843e19767a5e0ec443ce1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:07 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:50742
I20260808 05:07:07.245627 4610 tablet_replica.cc:330] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: stopping tablet replica
I20260808 05:07:07.245720 4610 raft_consensus.cc:2229] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:07:07.245846 4612 tablet_replica.cc:330] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: stopping tablet replica
I20260808 05:07:07.245960 4612 raft_consensus.cc:2229] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:07:07.245954 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 3988
I20260808 05:07:07.246068 4612 raft_consensus.cc:2258] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:07.251956 4612 ts_tablet_manager.cc:1905] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:07.253801 4612 ts_tablet_manager.cc:1918] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:07.253897 4612 log.cc:1196] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/e841d284f08843e19767a5e0ec443ce1
I20260808 05:07:07.254132 4612 ts_tablet_manager.cc:1939] T e841d284f08843e19767a5e0ec443ce1 P 75e1eec0215f475e8e1303dbeddb3329: Deleting consensus metadata
I20260808 05:07:07.254591 3883 catalog_manager.cc:4841] TS 75e1eec0215f475e8e1303dbeddb3329 (127.11.70.195:35331): tablet e841d284f08843e19767a5e0ec443ce1 (table test-table [id=d50d7f506b8440018120b99293295113]) successfully deleted
I20260808 05:07:07.257198 4610 raft_consensus.cc:2258] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:07.257709 4610 ts_tablet_manager.cc:1905] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:07.259837 4610 ts_tablet_manager.cc:1918] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:07.259909 4610 log.cc:1196] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/e841d284f08843e19767a5e0ec443ce1
I20260808 05:07:07.260166 4610 ts_tablet_manager.cc:1939] T e841d284f08843e19767a5e0ec443ce1 P 8da5970150464b8495a0b467f8b0e212: Deleting consensus metadata
I20260808 05:07:07.260716 3881 catalog_manager.cc:4841] TS 8da5970150464b8495a0b467f8b0e212 (127.11.70.194:42029): tablet e841d284f08843e19767a5e0ec443ce1 (table test-table [id=d50d7f506b8440018120b99293295113]) successfully deleted
W20260808 05:07:07.264441 3882 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:34541 (error 108)
I20260808 05:07:07.265050 4570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.264896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:34541 (local address 127.0.0.1:50750)
0808 05:07:07.264965 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:07.265012 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:34541: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 05:07:07.265121 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 4173
W20260808 05:07:07.269692 3882 catalog_manager.cc:4584] TS d5b33a861c634df298694943523779f1 (127.11.70.193:34541): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e841d284f08843e19767a5e0ec443ce1: Network error: Client connection negotiation failed: client connection to 127.11.70.193:34541: connect: Connection refused (error 111)
I20260808 05:07:07.277549 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 4364
I20260808 05:07:07.287787 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 3861
2026-08-08T05:07:07Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2637 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T05:07:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:07Z Disabled control of system clock
I20260808 05:07:07.324334 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43083
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:37753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:43083
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:07:07.407871 4621 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:07.408111 4621 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:07.408134 4621 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:07.409336 4621 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:07.409385 4621 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:07.409399 4621 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:07.409411 4621 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:07.409425 4621 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:07.410772 4621 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:43083
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43083
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4621
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:07.410977 4621 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:07.411224 4621 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:07.416374 4629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:07.416380 4631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:07.416380 4628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:07.416527 4621 server_base.cc:1034] running on GCE node
I20260808 05:07:07.416904 4621 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:07.417169 4621 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:07.418316 4621 hybrid_clock.cc:648] HybridClock initialized: now 1786165627418296 us; error 37 us; skew 500 ppm
I20260808 05:07:07.419579 4621 webserver.cc:460] Webserver started at http://127.11.70.254:34061/ using document root <none> and password file <none>
I20260808 05:07:07.419836 4621 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:07.419884 4621 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:07.419978 4621 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:07.421008 4621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "02426e162d01458b8381c13b8ecea6ef"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "d5909beac82255224efe4276c2fa432b"
server_key_iv: "1b5b2aa4790f429923d1e8fc8ed74d93"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.421329 4621 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "02426e162d01458b8381c13b8ecea6ef"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "d5909beac82255224efe4276c2fa432b"
server_key_iv: "1b5b2aa4790f429923d1e8fc8ed74d93"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.422621 4621 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:07.423341 4640 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.423501 4621 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.423593 4621 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "02426e162d01458b8381c13b8ecea6ef"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "d5909beac82255224efe4276c2fa432b"
server_key_iv: "1b5b2aa4790f429923d1e8fc8ed74d93"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.423650 4621 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:07.439534 4621 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:07.439814 4621 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:07.439924 4621 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:07.443955 4621 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:43083
I20260808 05:07:07.444016 4718 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:43083 every 8 connection(s)
I20260808 05:07:07.444393 4621 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:07.445576 4719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:07.448048 4719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef: Bootstrap starting.
I20260808 05:07:07.448684 4719 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:07.448993 4719 log.cc:824] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:07.449059 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 4621
I20260808 05:07:07.449205 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:07.449445 11547 external_mini_cluster.cc:1428] Setting key ffbab1c0e2087f0864d4685ce8d06901
I20260808 05:07:07.449834 4719 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef: No bootstrap required, opened a new log
I20260808 05:07:07.451985 4719 raft_consensus.cc:348] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02426e162d01458b8381c13b8ecea6ef" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43083 } }
I20260808 05:07:07.452143 4719 raft_consensus.cc:374] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:07.452194 4719 raft_consensus.cc:729] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02426e162d01458b8381c13b8ecea6ef, State: Initialized, Role: FOLLOWER
I20260808 05:07:07.452349 4719 consensus_queue.cc:260] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02426e162d01458b8381c13b8ecea6ef" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43083 } }
I20260808 05:07:07.452437 4719 raft_consensus.cc:388] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:07.452481 4719 raft_consensus.cc:482] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:07.452530 4719 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:07.453073 4719 raft_consensus.cc:504] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02426e162d01458b8381c13b8ecea6ef" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43083 } }
I20260808 05:07:07.453193 4719 leader_election.cc:302] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 02426e162d01458b8381c13b8ecea6ef; no voters:
I20260808 05:07:07.453426 4719 leader_election.cc:288] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:07.453456 4726 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:07.453573 4726 raft_consensus.cc:686] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [term 1 LEADER]: Becoming Leader. State: Replica: 02426e162d01458b8381c13b8ecea6ef, State: Running, Role: LEADER
I20260808 05:07:07.453670 4726 consensus_queue.cc:237] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02426e162d01458b8381c13b8ecea6ef" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43083 } }
I20260808 05:07:07.453712 4719 sys_catalog.cc:564] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:07.454002 4732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "02426e162d01458b8381c13b8ecea6ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02426e162d01458b8381c13b8ecea6ef" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43083 } } }
I20260808 05:07:07.454272 4732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:07.454181 4730 sys_catalog.cc:455] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 02426e162d01458b8381c13b8ecea6ef. Latest consensus state: current_term: 1 leader_uuid: "02426e162d01458b8381c13b8ecea6ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "02426e162d01458b8381c13b8ecea6ef" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43083 } } }
I20260808 05:07:07.454553 4730 sys_catalog.cc:458] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:07.454710 4741 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:07.455232 4741 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:07.456756 4725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.449985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41420 (local address 127.11.70.254:43083)
0808 05:07:07.450222 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.450230 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.450255 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:07:07.451139 (+ 884us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.451148 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.451209 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.451323 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:07.451613 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.453084 (+ 1471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.454245 (+ 1161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.454888 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.455015 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.456004 (+ 989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:07.456008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:07.456008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:07.456201 (+ 193us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:07.456243 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:07.456254 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:07.456346 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.456431 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.456522 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":104,"threads_started":1}
I20260808 05:07:07.456924 4741 catalog_manager.cc:1347] Generated new cluster ID: 70fb94ba2ada470b871386d1ae5973de
I20260808 05:07:07.456979 4741 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:07.469689 4741 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:07.470224 4741 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:07.473539 4741 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef: Generated new TSK 0
I20260808 05:07:07.473758 4741 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:07.479888 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43083
--builtin_ntp_servers=127.11.70.212:37753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:07:07.566457 4755 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:07.566732 4755 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:07.566756 4755 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:07.567924 4755 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:07.567968 4755 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:07.567994 4755 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:07:07.569351 4755 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4755
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:07.569613 4755 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:07.569940 4755 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:07.576174 4761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:07.576164 4763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:07.576215 4765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:07.576586 4755 server_base.cc:1034] running on GCE node
I20260808 05:07:07.576784 4755 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:07.577023 4755 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:07.578184 4755 hybrid_clock.cc:648] HybridClock initialized: now 1786165627578159 us; error 38 us; skew 500 ppm
I20260808 05:07:07.579730 4755 webserver.cc:460] Webserver started at http://127.11.70.193:33567/ using document root <none> and password file <none>
I20260808 05:07:07.579994 4755 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:07.580050 4755 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:07.580179 4755 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:07.581494 4755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "547dc06b7ac241ca96f6bfe013902707"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "f25cd9af939a7094205510181ad29a88"
server_key_iv: "f6341845ff2e52c8b10f5dc218548c87"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.581914 4755 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "547dc06b7ac241ca96f6bfe013902707"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "f25cd9af939a7094205510181ad29a88"
server_key_iv: "f6341845ff2e52c8b10f5dc218548c87"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.583498 4755 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 05:07:07.584211 4771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.584405 4755 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:07:07.584515 4755 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "547dc06b7ac241ca96f6bfe013902707"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "f25cd9af939a7094205510181ad29a88"
server_key_iv: "f6341845ff2e52c8b10f5dc218548c87"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.584604 4755 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:07.597631 4755 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:07.597966 4755 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:07.598125 4755 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:07.598356 4755 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:07.598703 4755 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:07.598768 4755 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.598814 4755 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:07.598842 4755 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.605446 4755 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:36099
I20260808 05:07:07.605494 4943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:36099 every 8 connection(s)
I20260808 05:07:07.605844 4755 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:07:07.606196 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 4755
I20260808 05:07:07.606334 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:07:07.606632 11547 external_mini_cluster.cc:1428] Setting key d876f385b9b05abe0a7f3a3230f8b0a2
I20260808 05:07:07.607733 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43083
--builtin_ntp_servers=127.11.70.212:37753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:07:07.611951 4725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.606913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:55683 (local address 127.11.70.254:43083)
0808 05:07:07.606980 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.606983 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.607302 (+ 319us) server_negotiation.cc:407] Connection header received
0808 05:07:07.607939 (+ 637us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.607940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.607955 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.607988 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:07.608794 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.609389 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.610390 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.610727 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.610787 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.611700 (+ 913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:07.611701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:07.611701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:07.611706 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:07.611721 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:07.611725 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:07.611774 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.611866 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.611889 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:07:07.612269 4952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.606922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:43083 (local address 127.11.70.193:55683)
0808 05:07:07.607144 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:07.607190 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:07.607800 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:07.608150 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:07.608154 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:07.608162 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:07.608689 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.608693 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.609503 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.609504 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.610293 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.610295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.610820 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.610822 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.610987 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.611543 (+ 556us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:07:07.611544 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:07.611584 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:07:07.611613 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:07.611790 (+ 177us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:07.611795 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:07.611798 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:07.611861 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 05:07:07.611984 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
I20260808 05:07:07.612897 4946 heartbeater.cc:347] Connected to a master server at 127.11.70.254:43083
I20260808 05:07:07.613008 4946 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:07.613193 4946 heartbeater.cc:511] Master 127.11.70.254:43083 requested a full tablet report, sending...
I20260808 05:07:07.613766 4672 ts_manager.cc:194] Registered new tserver with Master: 547dc06b7ac241ca96f6bfe013902707 (127.11.70.193:36099)
I20260808 05:07:07.614384 4672 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.193:55683
W20260808 05:07:07.702425 4954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:07.702693 4954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:07.702716 4954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:07.703922 4954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:07.703965 4954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:07.703991 4954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:07:07.705439 4954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:07.705711 4954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:07.706037 4954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:07.711248 4967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:07.711262 4963 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:07.711288 4962 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:07.711508 4954 server_base.cc:1034] running on GCE node
I20260808 05:07:07.711709 4954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:07.711978 4954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:07.713147 4954 hybrid_clock.cc:648] HybridClock initialized: now 1786165627713138 us; error 48 us; skew 500 ppm
I20260808 05:07:07.714453 4954 webserver.cc:460] Webserver started at http://127.11.70.194:43247/ using document root <none> and password file <none>
I20260808 05:07:07.714794 4954 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:07.714871 4954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:07.715025 4954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:07.716090 4954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "75a5853eb8c04a1d87e6983db768060e"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "a807586af993e7b7909751cf07be55ce"
server_key_iv: "bb776009fcd646619a16b0f10fd0f15e"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.716449 4954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "75a5853eb8c04a1d87e6983db768060e"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "a807586af993e7b7909751cf07be55ce"
server_key_iv: "bb776009fcd646619a16b0f10fd0f15e"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.717808 4954 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:07.718686 4974 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.718889 4954 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:07.718986 4954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "75a5853eb8c04a1d87e6983db768060e"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "a807586af993e7b7909751cf07be55ce"
server_key_iv: "bb776009fcd646619a16b0f10fd0f15e"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.719041 4954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:07.735467 4954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:07.735777 4954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:07.735900 4954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:07.736101 4954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:07.736476 4954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:07.736537 4954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.736582 4954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:07.736608 4954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.742545 4954 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:46333
I20260808 05:07:07.742594 5137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:46333 every 8 connection(s)
I20260808 05:07:07.742952 4954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:07:07.744935 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 4954
I20260808 05:07:07.745067 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:07:07.745296 11547 external_mini_cluster.cc:1428] Setting key 822d7240d3b9cd9dbabd7be52d947fe4
I20260808 05:07:07.746420 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43083
--builtin_ntp_servers=127.11.70.212:37753
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:07:07.748900 4725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.743751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:39711 (local address 127.11.70.254:43083)
0808 05:07:07.743823 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.743825 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.744097 (+ 272us) server_negotiation.cc:407] Connection header received
0808 05:07:07.744561 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.744562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.744573 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.744644 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:07.745562 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.746200 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.747344 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.747554 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.747633 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.748572 (+ 939us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:07.748574 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:07.748574 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:07.748579 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:07.748598 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:07.748603 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:07.748664 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.748754 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.748788 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:07:07.749032 5140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.743728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:43083 (local address 127.11.70.194:39711)
0808 05:07:07.743938 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:07.743982 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:07.744474 (+ 492us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:07.744794 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:07.744798 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:07.744806 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:07.745464 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.745470 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.746308 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.746309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.747234 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.747237 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.747641 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.747642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.747787 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.748419 (+ 632us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:07:07.748420 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:07.748450 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:07:07.748474 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:07.748671 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:07.748675 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:07.748678 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:07.748732 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:07:07.748820 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":108,"threads_started":1}
I20260808 05:07:07.749583 5138 heartbeater.cc:347] Connected to a master server at 127.11.70.254:43083
I20260808 05:07:07.749683 5138 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:07.749874 5138 heartbeater.cc:511] Master 127.11.70.254:43083 requested a full tablet report, sending...
I20260808 05:07:07.750334 4672 ts_manager.cc:194] Registered new tserver with Master: 75a5853eb8c04a1d87e6983db768060e (127.11.70.194:46333)
I20260808 05:07:07.750779 4672 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.194:39711
W20260808 05:07:07.833490 5141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:07.833720 5141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:07.833745 5141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:07.834949 5141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:07.834993 5141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:07.835021 5141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:07:07.836417 5141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:37753
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43083
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:07.836740 5141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:07.837061 5141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:07.842168 5151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:07.842183 5152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:07.842187 5157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:07.842626 5141 server_base.cc:1034] running on GCE node
I20260808 05:07:07.842846 5141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:07.843046 5141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:07.844242 5141 hybrid_clock.cc:648] HybridClock initialized: now 1786165627844220 us; error 35 us; skew 500 ppm
I20260808 05:07:07.845813 5141 webserver.cc:460] Webserver started at http://127.11.70.195:46851/ using document root <none> and password file <none>
I20260808 05:07:07.846071 5141 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:07.846124 5141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:07.846262 5141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:07.847474 5141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "bea64b3c218d4afd9cdfeac8fa94ce00"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "e1e7d57770eed084fadbbc7cc1979d57"
server_key_iv: "b34243447a26a55c474c7ac541638176"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.847857 5141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "bea64b3c218d4afd9cdfeac8fa94ce00"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "e1e7d57770eed084fadbbc7cc1979d57"
server_key_iv: "b34243447a26a55c474c7ac541638176"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.849311 5141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:07:07.850184 5166 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.850427 5141 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:07.850586 5141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "bea64b3c218d4afd9cdfeac8fa94ce00"
format_stamp: "Formatted at 2026-08-08 05:07:07 on dist-test-slave-7kzw"
server_key: "e1e7d57770eed084fadbbc7cc1979d57"
server_key_iv: "b34243447a26a55c474c7ac541638176"
server_key_version: "encryptionkey@0"
I20260808 05:07:07.850708 5141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:07.867969 5141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:07.868306 5141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:07.868474 5141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:07.868724 5141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:07.869077 5141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:07.869115 5141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.869163 5141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:07.869190 5141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:07.875213 5141 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:39715
I20260808 05:07:07.875262 5339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:39715 every 8 connection(s)
I20260808 05:07:07.875604 5141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:07:07.881158 4725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.876369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:46959 (local address 127.11.70.254:43083)
0808 05:07:07.876424 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.876426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.876686 (+ 260us) server_negotiation.cc:407] Connection header received
0808 05:07:07.877298 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.877300 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.877314 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.877379 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:07.878093 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.878670 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.879660 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.879871 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.879949 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.880851 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:07.880853 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:07.880853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:07.880858 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:07.880873 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:07.880878 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:07.880945 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.881047 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.881075 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:07:07.881419 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.876364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:43083 (local address 127.11.70.195:46959)
0808 05:07:07.876554 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:07.876589 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:07.877148 (+ 559us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:07.877452 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:07.877457 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:07.877474 (+ 17us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:07.877987 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.877992 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.878779 (+ 787us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.878780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.879560 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.879563 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.879959 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.879960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.880103 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.880696 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:07:07.880697 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:07.880726 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:07:07.880752 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:07.880947 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:07.880954 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:07.880957 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:07.881047 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:07:07.881151 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":78,"threads_started":1}
I20260808 05:07:07.882092 5340 heartbeater.cc:347] Connected to a master server at 127.11.70.254:43083
I20260808 05:07:07.882179 5340 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:07.882398 5340 heartbeater.cc:511] Master 127.11.70.254:43083 requested a full tablet report, sending...
I20260808 05:07:07.882865 4672 ts_manager.cc:194] Registered new tserver with Master: bea64b3c218d4afd9cdfeac8fa94ce00 (127.11.70.195:39715)
I20260808 05:07:07.883286 4672 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.195:46959
I20260808 05:07:07.883977 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 5141
I20260808 05:07:07.884086 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:07:07.884310 11547 external_mini_cluster.cc:1428] Setting key cbcdff5d5ac4faaed0f19656ebbdb77d
I20260808 05:07:07.885406 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:07:07.889735 4725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.886914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41422 (local address 127.11.70.254:43083)
0808 05:07:07.886990 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.886992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.887033 (+ 41us) server_negotiation.cc:407] Connection header received
0808 05:07:07.887086 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.887086 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.887095 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.887143 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:07.887374 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.887934 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.888664 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.888841 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.888891 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.889501 (+ 610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:07.889502 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:07.889502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:07.889506 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:07.889519 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:07.889523 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:07.889566 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.889616 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.889634 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:07:07.891291 4672 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:07:07.892872 4672 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:07:07.899421 5355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.895508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39060 (local address 127.11.70.193:36099)
0808 05:07:07.895717 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.895720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.895932 (+ 212us) server_negotiation.cc:407] Connection header received
0808 05:07:07.896062 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.896065 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.896080 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.896135 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:07.896371 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.897383 (+ 1012us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.898456 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.899008 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.899114 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.899212 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.899292 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.899331 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":84,"threads_started":1}
I20260808 05:07:07.899524 5350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.895243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:46333 (local address 127.0.0.1:35842)
0808 05:07:07.895355 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:07.895399 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:07.895466 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:07.895835 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:07.895839 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:07.895842 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:07.895917 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.895919 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.897265 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.897266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.898311 (+ 1045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.898314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.899279 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.899280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.899337 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.899341 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:07:07.899373 (+ 32us) client_negotiation.cc:240] Negotiation successful
0808 05:07:07.899414 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":63,"threads_started":1}
I20260808 05:07:07.899411 5352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.895295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:36099 (local address 127.0.0.1:39060)
0808 05:07:07.895871 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:07.895881 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:07.895961 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:07.896243 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:07.896244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:07.896246 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:07.896286 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.896287 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.897472 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.897473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.898380 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.898384 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.899117 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.899119 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.899195 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.899208 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 05:07:07.899280 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 05:07:07.899334 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":559,"thread_start_us":78,"threads_started":1}
I20260808 05:07:07.899760 5353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.895419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35842 (local address 127.11.70.194:46333)
0808 05:07:07.895630 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.895636 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.895647 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:07:07.895690 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.895692 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.895708 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.896003 (+ 295us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:07.896071 (+ 68us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.897170 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.898397 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.899169 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.899462 (+ 293us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.899571 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.899601 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.899647 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":89,"threads_started":1}
I20260808 05:07:07.900472 4841 tablet_service.cc:1467] Processing CreateTablet for tablet d5da67f724ce4730b7f9591d918011a4 (DEFAULT_TABLE table=test-table [id=7586df72e2734891a495b8a381d2a60f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:07.900471 5042 tablet_service.cc:1467] Processing CreateTablet for tablet d5da67f724ce4730b7f9591d918011a4 (DEFAULT_TABLE table=test-table [id=7586df72e2734891a495b8a381d2a60f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:07.900807 5042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5da67f724ce4730b7f9591d918011a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:07.900833 4841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5da67f724ce4730b7f9591d918011a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:07.902627 5351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.895267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:39715 (local address 127.0.0.1:46308)
0808 05:07:07.895684 (+ 417us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:07.895695 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:07.895782 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:07.896044 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:07.896045 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:07.896048 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:07.896082 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.896083 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.897024 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.897025 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.898298 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:07.898301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.899381 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.899382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:07.899432 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.899435 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:07.899632 (+ 197us) client_negotiation.cc:240] Negotiation successful
0808 05:07:07.899670 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":398,"thread_start_us":102,"threads_started":1}
I20260808 05:07:07.902863 5354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:07.895497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46308 (local address 127.11.70.195:39715)
0808 05:07:07.895838 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:07.895841 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:07.895850 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:07.895884 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:07.895886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:07.895901 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:07.895977 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:07.896165 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.896932 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.898517 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:07.899179 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:07.899259 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:07.899348 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:07.899783 (+ 435us) server_negotiation.cc:299] Negotiation successful
0808 05:07:07.902779 (+ 2996us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":303,"thread_start_us":91,"threads_started":1}
I20260808 05:07:07.903542 5237 tablet_service.cc:1467] Processing CreateTablet for tablet d5da67f724ce4730b7f9591d918011a4 (DEFAULT_TABLE table=test-table [id=7586df72e2734891a495b8a381d2a60f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:07.903718 5356 tablet_bootstrap.cc:492] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707: Bootstrap starting.
I20260808 05:07:07.903894 5237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d5da67f724ce4730b7f9591d918011a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:07.904399 5356 tablet_bootstrap.cc:654] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:07.904711 5356 log.cc:824] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:07.905496 5356 tablet_bootstrap.cc:492] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707: No bootstrap required, opened a new log
I20260808 05:07:07.905553 5356 ts_tablet_manager.cc:1397] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:07:07.906862 5359 tablet_bootstrap.cc:492] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: Bootstrap starting.
I20260808 05:07:07.907604 5359 tablet_bootstrap.cc:654] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:07.907766 5360 tablet_bootstrap.cc:492] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: Bootstrap starting.
I20260808 05:07:07.907960 5359 log.cc:824] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:07.907893 5356 raft_consensus.cc:348] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } }
I20260808 05:07:07.908054 5356 raft_consensus.cc:374] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:07.908106 5356 raft_consensus.cc:729] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 547dc06b7ac241ca96f6bfe013902707, State: Initialized, Role: FOLLOWER
I20260808 05:07:07.908237 5356 consensus_queue.cc:260] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } }
I20260808 05:07:07.908514 5356 ts_tablet_manager.cc:1428] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:07.908531 5360 tablet_bootstrap.cc:654] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:07.908793 5359 tablet_bootstrap.cc:492] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: No bootstrap required, opened a new log
I20260808 05:07:07.908824 5360 log.cc:824] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:07.908877 5359 ts_tablet_manager.cc:1397] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:07.909502 5360 tablet_bootstrap.cc:492] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: No bootstrap required, opened a new log
I20260808 05:07:07.909556 5360 ts_tablet_manager.cc:1397] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:07:07.910576 4946 heartbeater.cc:503] Master 127.11.70.254:43083 was elected leader, sending a full tablet report...
I20260808 05:07:07.911020 5359 raft_consensus.cc:348] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } }
I20260808 05:07:07.911175 5359 raft_consensus.cc:374] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:07.911209 5359 raft_consensus.cc:729] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bea64b3c218d4afd9cdfeac8fa94ce00, State: Initialized, Role: FOLLOWER
I20260808 05:07:07.911319 5359 consensus_queue.cc:260] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } }
I20260808 05:07:07.911604 5359 ts_tablet_manager.cc:1428] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:07.911856 5340 heartbeater.cc:503] Master 127.11.70.254:43083 was elected leader, sending a full tablet report...
I20260808 05:07:07.912130 5360 raft_consensus.cc:348] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } }
I20260808 05:07:07.912281 5360 raft_consensus.cc:374] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:07.912331 5360 raft_consensus.cc:729] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75a5853eb8c04a1d87e6983db768060e, State: Initialized, Role: FOLLOWER
I20260808 05:07:07.912456 5360 consensus_queue.cc:260] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } }
I20260808 05:07:07.912720 5360 ts_tablet_manager.cc:1428] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:07.912789 5138 heartbeater.cc:503] Master 127.11.70.254:43083 was elected leader, sending a full tablet report...
W20260808 05:07:07.993574 5139 tablet.cc:2369] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:07:08.077716 5366 raft_consensus.cc:482] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:07:08.077860 5366 raft_consensus.cc:504] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } }
I20260808 05:07:08.078289 5366 leader_election.cc:288] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75a5853eb8c04a1d87e6983db768060e (127.11.70.194:46333), 547dc06b7ac241ca96f6bfe013902707 (127.11.70.193:36099)
I20260808 05:07:08.082233 5353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:08.078544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:55981 (local address 127.11.70.194:46333)
0808 05:07:08.078639 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:08.078642 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:08.078652 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:07:08.078686 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:08.078687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:08.078697 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:08.078780 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:08.078965 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.079727 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.081257 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.081829 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.081903 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:08.081912 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:08.082113 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 05:07:08.082155 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260808 05:07:08.082255 5355 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:08.078583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:48505 (local address 127.11.70.193:36099)
0808 05:07:08.078692 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:08.078695 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:08.078871 (+ 176us) server_negotiation.cc:407] Connection header received
0808 05:07:08.078900 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:08.078901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:08.078911 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:08.078987 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:08.079133 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.079814 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.081257 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.081823 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.081903 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:08.081912 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:08.082113 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 05:07:08.082155 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260808 05:07:08.082258 5344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:08.078447 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:46333 (local address 127.11.70.195:55981)
0808 05:07:08.078545 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:08.078557 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:08.078601 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:08.078796 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:08.078797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:08.078799 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:08.078880 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:08.078882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.079828 (+ 946us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.079829 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:08.081147 (+ 1318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:08.081152 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.081925 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.081927 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:08.082018 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:08.082025 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 05:07:08.082089 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 05:07:08.082148 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":75,"mutex_wait_us":12}
I20260808 05:07:08.082266 5368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:08.078463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:36099 (local address 127.11.70.195:48505)
0808 05:07:08.078784 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:08.078794 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:08.078849 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:08.078998 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:08.078999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:08.079000 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:08.079061 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:08.079062 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.079885 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.079885 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:08.081148 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:08.081152 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.081925 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.081927 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:08.082018 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:08.082025 (+ 7us) client_negotiation.cc:769] Sending connection context
0808 05:07:08.082089 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 05:07:08.082151 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":303,"mutex_wait_us":143,"thread_start_us":134,"threads_started":1}
I20260808 05:07:08.082751 4870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5da67f724ce4730b7f9591d918011a4" candidate_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "547dc06b7ac241ca96f6bfe013902707" is_pre_election: true
I20260808 05:07:08.082834 5077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5da67f724ce4730b7f9591d918011a4" candidate_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a5853eb8c04a1d87e6983db768060e" is_pre_election: true
I20260808 05:07:08.082955 4870 raft_consensus.cc:2454] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea64b3c218d4afd9cdfeac8fa94ce00 in term 0.
I20260808 05:07:08.083025 5077 raft_consensus.cc:2454] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bea64b3c218d4afd9cdfeac8fa94ce00 in term 0.
I20260808 05:07:08.083349 5169 leader_election.cc:302] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75a5853eb8c04a1d87e6983db768060e, bea64b3c218d4afd9cdfeac8fa94ce00; no voters:
I20260808 05:07:08.083474 5366 raft_consensus.cc:2781] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:07:08.083534 5366 raft_consensus.cc:482] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:07:08.083556 5366 raft_consensus.cc:3037] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:08.084270 5366 raft_consensus.cc:504] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } }
I20260808 05:07:08.084417 5366 leader_election.cc:288] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [CANDIDATE]: Term 1 election: Requested vote from peers 75a5853eb8c04a1d87e6983db768060e (127.11.70.194:46333), 547dc06b7ac241ca96f6bfe013902707 (127.11.70.193:36099)
I20260808 05:07:08.084590 4870 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5da67f724ce4730b7f9591d918011a4" candidate_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "547dc06b7ac241ca96f6bfe013902707"
I20260808 05:07:08.084591 5077 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d5da67f724ce4730b7f9591d918011a4" candidate_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75a5853eb8c04a1d87e6983db768060e"
I20260808 05:07:08.084681 4870 raft_consensus.cc:3037] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:08.084682 5077 raft_consensus.cc:3037] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:08.085597 5077 raft_consensus.cc:2454] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea64b3c218d4afd9cdfeac8fa94ce00 in term 1.
I20260808 05:07:08.085597 4870 raft_consensus.cc:2454] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bea64b3c218d4afd9cdfeac8fa94ce00 in term 1.
I20260808 05:07:08.085825 5168 leader_election.cc:302] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 547dc06b7ac241ca96f6bfe013902707, bea64b3c218d4afd9cdfeac8fa94ce00; no voters:
I20260808 05:07:08.085968 5366 raft_consensus.cc:2781] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:08.086115 5366 raft_consensus.cc:686] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 1 LEADER]: Becoming Leader. State: Replica: bea64b3c218d4afd9cdfeac8fa94ce00, State: Running, Role: LEADER
I20260808 05:07:08.086227 5366 consensus_queue.cc:237] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } }
I20260808 05:07:08.087196 4672 catalog_manager.cc:5495] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 reported cstate change: term changed from 0 to 1, leader changed from <none> to bea64b3c218d4afd9cdfeac8fa94ce00 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bea64b3c218d4afd9cdfeac8fa94ce00" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 39715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 } health_report { overall_health: UNKNOWN } } }
W20260808 05:07:08.106616 4948 tablet.cc:2369] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:07:08.126228 5342 tablet.cc:2369] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:07:08.127408 5354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:08.124677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46312 (local address 127.11.70.195:39715)
0808 05:07:08.124752 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:08.124754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:08.124764 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:07:08.124809 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:08.124810 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:08.124832 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:08.124909 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:08.125048 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.125583 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.126360 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:08.126688 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:08.126800 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:08.126948 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:08.127063 (+ 115us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:08.127136 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:08.127161 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 05:07:08.127181 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:07:08.129369 5077 raft_consensus.cc:1261] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [term 1 FOLLOWER]: Refusing update from remote peer bea64b3c218d4afd9cdfeac8fa94ce00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:08.129393 4870 raft_consensus.cc:1261] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [term 1 FOLLOWER]: Refusing update from remote peer bea64b3c218d4afd9cdfeac8fa94ce00: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:08.129792 5370 consensus_queue.cc:1035] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75a5853eb8c04a1d87e6983db768060e" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:08.129954 5366 consensus_queue.cc:1035] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [LEADER]: Connected to new peer: Peer: permanent_uuid: "547dc06b7ac241ca96f6bfe013902707" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 36099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:08.132162 5375 mvcc.cc:205] Tried to move back new op lower bound from 7316134412814901248 to 7316134412642111488. Current Snapshot: MvccSnapshot[applied={T|T < 7316134412814901248}]
I20260808 05:07:08.134194 5380 mvcc.cc:205] Tried to move back new op lower bound from 7316134412814901248 to 7316134412642111488. Current Snapshot: MvccSnapshot[applied={T|T < 7316134412814901248 or (T in {7316134412814901248})}]
I20260808 05:07:08.135051 4671 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:08.135176 4671 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:08.136070 4671 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 02426e162d01458b8381c13b8ecea6ef: Sending DeleteTablet for 3 replicas of tablet d5da67f724ce4730b7f9591d918011a4
I20260808 05:07:08.136457 5237 tablet_service.cc:1514] Processing DeleteTablet for tablet d5da67f724ce4730b7f9591d918011a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:08 UTC) from {username='slave'} at 127.0.0.1:46308
I20260808 05:07:08.136539 5042 tablet_service.cc:1514] Processing DeleteTablet for tablet d5da67f724ce4730b7f9591d918011a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:08 UTC) from {username='slave'} at 127.0.0.1:35842
I20260808 05:07:08.136554 4841 tablet_service.cc:1514] Processing DeleteTablet for tablet d5da67f724ce4730b7f9591d918011a4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:08 UTC) from {username='slave'} at 127.0.0.1:39060
I20260808 05:07:08.136781 5395 tablet_replica.cc:330] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: stopping tablet replica
I20260808 05:07:08.136816 5398 tablet_replica.cc:330] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707: stopping tablet replica
I20260808 05:07:08.136894 5395 raft_consensus.cc:2229] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:07:08.136904 5398 raft_consensus.cc:2229] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:07:08.137037 5398 raft_consensus.cc:2258] T d5da67f724ce4730b7f9591d918011a4 P 547dc06b7ac241ca96f6bfe013902707 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:08.137043 5395 raft_consensus.cc:2258] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:08.137094 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 4755
I20260808 05:07:08.144904 5395 ts_tablet_manager.cc:1905] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:08.146521 5395 ts_tablet_manager.cc:1918] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:08.146623 5395 log.cc:1196] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/d5da67f724ce4730b7f9591d918011a4
I20260808 05:07:08.147204 5395 ts_tablet_manager.cc:1939] T d5da67f724ce4730b7f9591d918011a4 P 75a5853eb8c04a1d87e6983db768060e: Deleting consensus metadata
I20260808 05:07:08.147421 5394 tablet_replica.cc:330] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: stopping tablet replica
I20260808 05:07:08.147615 5394 raft_consensus.cc:2229] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:07:08.147826 5394 raft_consensus.cc:2258] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:08.148327 5394 ts_tablet_manager.cc:1905] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:08.149729 5394 ts_tablet_manager.cc:1918] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:08.149834 5394 log.cc:1196] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/d5da67f724ce4730b7f9591d918011a4
I20260808 05:07:08.150195 5394 ts_tablet_manager.cc:1939] T d5da67f724ce4730b7f9591d918011a4 P bea64b3c218d4afd9cdfeac8fa94ce00: Deleting consensus metadata
I20260808 05:07:08.150641 4643 catalog_manager.cc:4841] TS 75a5853eb8c04a1d87e6983db768060e (127.11.70.194:46333): tablet d5da67f724ce4730b7f9591d918011a4 (table test-table [id=7586df72e2734891a495b8a381d2a60f]) successfully deleted
I20260808 05:07:08.150746 4646 catalog_manager.cc:4841] TS bea64b3c218d4afd9cdfeac8fa94ce00 (127.11.70.195:39715): tablet d5da67f724ce4730b7f9591d918011a4 (table test-table [id=7586df72e2734891a495b8a381d2a60f]) successfully deleted
W20260808 05:07:08.152252 4642 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:36099 (error 108)
I20260808 05:07:08.152876 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 4954
I20260808 05:07:08.161821 5351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:08.152977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:36099 (local address 127.0.0.1:39068)
0808 05:07:08.161728 (+ 8751us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:08.161785 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:36099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8724}
W20260808 05:07:08.162050 4642 catalog_manager.cc:4584] TS 547dc06b7ac241ca96f6bfe013902707 (127.11.70.193:36099): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d5da67f724ce4730b7f9591d918011a4: Network error: Client connection negotiation failed: client connection to 127.11.70.193:36099: connect: Connection refused (error 111)
I20260808 05:07:08.171769 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 5141
I20260808 05:07:08.184379 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 4621
2026-08-08T05:07:08Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (895 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:08 dist-test-slave-7kzw krb5kdc[5402](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:08 dist-test-slave-7kzw krb5kdc[5402](info): set up 2 sockets
Aug 08 05:07:08 dist-test-slave-7kzw krb5kdc[5402](info): commencing operation
krb5kdc: starting...
W20260808 05:07:09.412721 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.202s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:09 dist-test-slave-7kzw krb5kdc[5402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:09.545866 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:39333
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:39333
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:09.633577 5419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:09.633853 5419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:09.633893 5419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:09.635054 5419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:09.635138 5419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:09.635164 5419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:09.635185 5419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:09.635213 5419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:09.636703 5419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:39333
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:39333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:09.636993 5419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:09.637230 5419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:09.642156 5427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:09.642190 5430 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:09.642309 5428 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:09.642561 5419 server_base.cc:1034] running on GCE node
I20260808 05:07:09.642858 5419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:09.643105 5419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:09.644255 5419 hybrid_clock.cc:648] HybridClock initialized: now 1786165629644243 us; error 32 us; skew 500 ppm
Aug 08 05:07:09 dist-test-slave-7kzw krb5kdc[5402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165629, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:09.647233 5419 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:09.647760 5419 webserver.cc:460] Webserver started at http://127.11.70.254:42043/ using document root <none> and password file <none>
I20260808 05:07:09.648025 5419 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:09.648077 5419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:09.648240 5419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:09.649389 5419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "3a372627b7204274bf807858ae6200e4"
format_stamp: "Formatted at 2026-08-08 05:07:09 on dist-test-slave-7kzw"
server_key: "a42150e5c153a19e894b99a5beac38dc"
server_key_iv: "1b5214ac605f3529fc205c4a64fb867e"
server_key_version: "encryptionkey@0"
I20260808 05:07:09.649811 5419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "3a372627b7204274bf807858ae6200e4"
format_stamp: "Formatted at 2026-08-08 05:07:09 on dist-test-slave-7kzw"
server_key: "a42150e5c153a19e894b99a5beac38dc"
server_key_iv: "1b5214ac605f3529fc205c4a64fb867e"
server_key_version: "encryptionkey@0"
I20260808 05:07:09.651614 5419 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:07:09.652575 5438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:09.652835 5419 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:09.652958 5419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "3a372627b7204274bf807858ae6200e4"
format_stamp: "Formatted at 2026-08-08 05:07:09 on dist-test-slave-7kzw"
server_key: "a42150e5c153a19e894b99a5beac38dc"
server_key_iv: "1b5214ac605f3529fc205c4a64fb867e"
server_key_version: "encryptionkey@0"
I20260808 05:07:09.653040 5419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:09.663764 5419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:09.667212 5419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:09.667448 5419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:09.672093 5419 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:39333
I20260808 05:07:09.672156 5515 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:39333 every 8 connection(s)
I20260808 05:07:09.672497 5419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:09.673379 5516 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:09.675796 5516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4: Bootstrap starting.
I20260808 05:07:09.676397 5516 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:09.676744 5516 log.cc:824] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:09.677556 5516 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4: No bootstrap required, opened a new log
I20260808 05:07:09.679358 5516 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a372627b7204274bf807858ae6200e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39333 } }
I20260808 05:07:09.679502 5516 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:09.679526 5516 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a372627b7204274bf807858ae6200e4, State: Initialized, Role: FOLLOWER
I20260808 05:07:09.679697 5516 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a372627b7204274bf807858ae6200e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39333 } }
I20260808 05:07:09.679766 5516 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:09.679808 5516 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:09.679860 5516 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:09.680405 5516 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a372627b7204274bf807858ae6200e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39333 } }
I20260808 05:07:09.680524 5516 leader_election.cc:302] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a372627b7204274bf807858ae6200e4; no voters:
I20260808 05:07:09.680725 5516 leader_election.cc:288] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:09.680763 5520 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:09.680974 5520 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [term 1 LEADER]: Becoming Leader. State: Replica: 3a372627b7204274bf807858ae6200e4, State: Running, Role: LEADER
I20260808 05:07:09.681111 5516 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:09.681094 5520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a372627b7204274bf807858ae6200e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39333 } }
I20260808 05:07:09.681579 5522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a372627b7204274bf807858ae6200e4. Latest consensus state: current_term: 1 leader_uuid: "3a372627b7204274bf807858ae6200e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a372627b7204274bf807858ae6200e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39333 } } }
I20260808 05:07:09.681675 5522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:09.682037 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 5419
I20260808 05:07:09.682171 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:09.682263 5530 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:09.682400 11547 external_mini_cluster.cc:1428] Setting key 8e0b7acfeb798bb4a361b38f948612f6
I20260808 05:07:09.681756 5521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a372627b7204274bf807858ae6200e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a372627b7204274bf807858ae6200e4" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39333 } } }
I20260808 05:07:09.682752 5521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:09.682894 5530 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:09.684953 5530 catalog_manager.cc:1347] Generated new cluster ID: 900626af529c47488bd94befea426c26
I20260808 05:07:09.685014 5530 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:07:09 dist-test-slave-7kzw krb5kdc[5402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165629, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:09.694701 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:09.683176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56938 (local address 127.11.70.254:39333)
0808 05:07:09.683377 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:09.683387 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:09.683421 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:07:09.683554 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:09.683562 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:09.683630 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:09.683795 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:09.684706 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:09.686111 (+ 1405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:09.687195 (+ 1084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:09.687842 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:09.687937 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:09.690772 (+ 2835us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:09.690777 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:09.690777 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:09.690788 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:09.692781 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:09.693145 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:09.693147 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:09.693148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:09.693242 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:09.693407 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:09.693408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:09.693408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:09.693706 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:09.693846 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:09.694306 (+ 460us) server_negotiation.cc:299] Negotiation successful
0808 05:07:09.694438 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":99,"threads_started":1}
I20260808 05:07:09.712596 5530 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:09.713158 5530 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:09.722903 5530 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4: Generated new TSK 0
I20260808 05:07:09.723110 5530 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:07:09.758057 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39333
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:09.874738 5553 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:09.874944 5553 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:09.874969 5553 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:09.876111 5553 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:09.876151 5553 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:09.876178 5553 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:07:09.877625 5553 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5553
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:09.877878 5553 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:09.878115 5553 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:09.883389 5566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:09.883375 5563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:09.883364 5558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:09.883733 5553 server_base.cc:1034] running on GCE node
I20260808 05:07:09.883931 5553 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:09.884192 5553 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:09.885406 5553 hybrid_clock.cc:648] HybridClock initialized: now 1786165629885391 us; error 30 us; skew 500 ppm
Aug 08 05:07:09 dist-test-slave-7kzw krb5kdc[5402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165629, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:09.888177 5553 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:07:09.888767 5553 webserver.cc:460] Webserver started at http://127.11.70.193:42963/ using document root <none> and password file <none>
I20260808 05:07:09.889029 5553 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:09.889103 5553 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:09.889266 5553 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:09.890415 5553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "2bd18ea5b2a04ce48cd783ed38a05574"
format_stamp: "Formatted at 2026-08-08 05:07:09 on dist-test-slave-7kzw"
server_key: "fb41bc15848d46a733ffed0bce70034b"
server_key_iv: "d0c5c51be4850d289ff38ee65677959b"
server_key_version: "encryptionkey@0"
I20260808 05:07:09.890880 5553 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "2bd18ea5b2a04ce48cd783ed38a05574"
format_stamp: "Formatted at 2026-08-08 05:07:09 on dist-test-slave-7kzw"
server_key: "fb41bc15848d46a733ffed0bce70034b"
server_key_iv: "d0c5c51be4850d289ff38ee65677959b"
server_key_version: "encryptionkey@0"
I20260808 05:07:09.892334 5553 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:09.893126 5578 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:09.893306 5553 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:07:09.893419 5553 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "2bd18ea5b2a04ce48cd783ed38a05574"
format_stamp: "Formatted at 2026-08-08 05:07:09 on dist-test-slave-7kzw"
server_key: "fb41bc15848d46a733ffed0bce70034b"
server_key_iv: "d0c5c51be4850d289ff38ee65677959b"
server_key_version: "encryptionkey@0"
I20260808 05:07:09.893507 5553 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:09.924793 5553 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:09.927101 5553 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:09.927299 5553 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:09.927582 5553 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:09.927971 5553 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:09.928038 5553 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:09.928085 5553 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:09.928118 5553 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:09.934710 5553 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:46575
I20260808 05:07:09.934769 5742 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:46575 every 8 connection(s)
I20260808 05:07:09.935177 5553 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:07:09 dist-test-slave-7kzw krb5kdc[5402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165629, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:09.944952 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:09.936009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:51039 (local address 127.11.70.254:39333)
0808 05:07:09.936077 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:09.936079 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:09.936308 (+ 229us) server_negotiation.cc:407] Connection header received
0808 05:07:09.936867 (+ 559us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:09.936868 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:09.936886 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:09.936936 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:09.937973 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:09.938550 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:09.939572 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:09.939774 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:09.939848 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:09.942091 (+ 2243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:09.942093 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:09.942093 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:09.942101 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:09.943502 (+ 1401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:09.943918 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:09.943920 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:09.943920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:09.943983 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:09.944249 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:09.944250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:09.944250 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:09.944386 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:09.944468 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:09.944759 (+ 291us) server_negotiation.cc:299] Negotiation successful
0808 05:07:09.944854 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:07:09.945159 5745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:09.935971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39333 (local address 127.11.70.193:51039)
0808 05:07:09.936174 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:09.936213 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:09.936752 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:09.937029 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:09.937032 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:09.937639 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:09.937860 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:09.937865 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:09.938648 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:09.938649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:09.939461 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:09.939463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:09.939865 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:09.939866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:09.939998 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:09.940519 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:09.940528 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:09.941977 (+ 1449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:09.943588 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:09.943596 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:09.943598 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:09.943837 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:09.944052 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:09.944053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:09.944054 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:09.944170 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:09.944457 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:09.944465 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:09.944613 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 05:07:09.944723 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 05:07:09.944899 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":93,"threads_started":1}
I20260808 05:07:09.945207 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 5553
I20260808 05:07:09.945340 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:07:09.945582 11547 external_mini_cluster.cc:1428] Setting key d16b963faea76c8d19d5c721e45a2961
I20260808 05:07:09.946301 5743 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39333
I20260808 05:07:09.946429 5743 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:09.946650 5743 heartbeater.cc:511] Master 127.11.70.254:39333 requested a full tablet report, sending...
I20260808 05:07:09.947216 5464 ts_manager.cc:194] Registered new tserver with Master: 2bd18ea5b2a04ce48cd783ed38a05574 (127.11.70.193:46575)
I20260808 05:07:09.947880 5464 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:51039
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:07:09.978399 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39333
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:10.064435 5751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:10.064659 5751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:10.064684 5751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:10.065864 5751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:10.065912 5751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:10.065938 5751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:07:10.067483 5751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:10.067749 5751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:10.068001 5751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:10.073381 5760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.073413 5759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:10.073581 5751 server_base.cc:1034] running on GCE node
W20260808 05:07:10.073381 5763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:10.073899 5751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:10.074162 5751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:10.075317 5751 hybrid_clock.cc:648] HybridClock initialized: now 1786165630075303 us; error 34 us; skew 500 ppm
Aug 08 05:07:10 dist-test-slave-7kzw krb5kdc[5402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165630, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:10.077950 5751 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:07:10.078437 5751 webserver.cc:460] Webserver started at http://127.11.70.194:39481/ using document root <none> and password file <none>
I20260808 05:07:10.078706 5751 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:10.078780 5751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:10.078948 5751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:10.080061 5751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "21b90799dc794bed8478c55fd18b2896"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "3f0f5c4cbc0d5b6462fa8c34319fbf1e"
server_key_iv: "558cac00a2324966b0de71dae3d5123f"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.080504 5751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "21b90799dc794bed8478c55fd18b2896"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "3f0f5c4cbc0d5b6462fa8c34319fbf1e"
server_key_iv: "558cac00a2324966b0de71dae3d5123f"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.082335 5751 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:07:10.083405 5771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.083633 5751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:10.083753 5751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "21b90799dc794bed8478c55fd18b2896"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "3f0f5c4cbc0d5b6462fa8c34319fbf1e"
server_key_iv: "558cac00a2324966b0de71dae3d5123f"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.083847 5751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:10.096272 5751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:10.098608 5751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:10.098774 5751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:10.099026 5751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:10.099359 5751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:10.099416 5751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.099464 5751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:10.099489 5751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.105582 5751 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:35593
I20260808 05:07:10.105639 5935 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:35593 every 8 connection(s)
I20260808 05:07:10.105988 5751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:07:10 dist-test-slave-7kzw krb5kdc[5402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165630, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:10.115347 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 5751
I20260808 05:07:10.115506 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:07:10.115706 11547 external_mini_cluster.cc:1428] Setting key 152576669627714e48d0a61e1bb59534
I20260808 05:07:10.115971 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.106835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:49389 (local address 127.11.70.254:39333)
0808 05:07:10.106890 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.106893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.107036 (+ 143us) server_negotiation.cc:407] Connection header received
0808 05:07:10.107566 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.107567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.107579 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.107654 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:10.108630 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.109144 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.110212 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.110407 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.110519 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.112781 (+ 2262us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:10.112782 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:10.112783 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:10.112790 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:10.114371 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:10.114849 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:10.114850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:10.114851 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:10.114907 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:10.115158 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:10.115159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:10.115159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:10.115289 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:10.115377 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.115789 (+ 412us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.115879 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:07:10.116183 5940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.106727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39333 (local address 127.11.70.194:49389)
0808 05:07:10.106913 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.106956 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:10.107465 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:10.107710 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:10.107713 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:10.108306 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:10.108503 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.108507 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.109262 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.109263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.110104 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.110106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.110551 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.110552 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.110665 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.111171 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:10.111180 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:10.112683 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:10.114445 (+ 1762us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:10.114451 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:10.114452 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:10.114777 (+ 325us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:10.114975 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:10.114976 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:10.114976 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:10.115093 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:10.115384 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:10.115392 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:10.115581 (+ 189us) client_negotiation.cc:769] Sending connection context
0808 05:07:10.115752 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 05:07:10.115924 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":108,"threads_started":1}
I20260808 05:07:10.116842 5938 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39333
I20260808 05:07:10.116956 5938 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:10.117141 5938 heartbeater.cc:511] Master 127.11.70.254:39333 requested a full tablet report, sending...
I20260808 05:07:10.117575 5464 ts_manager.cc:194] Registered new tserver with Master: 21b90799dc794bed8478c55fd18b2896 (127.11.70.194:35593)
I20260808 05:07:10.117964 5464 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:49389
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:07:10.146165 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39333
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:10.236354 5946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:10.236567 5946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:10.236591 5946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:10.237772 5946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:10.237818 5946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:10.237845 5946 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:07:10.239449 5946 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:39333
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:10.239714 5946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:10.239965 5946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:10.245288 5956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.245342 5953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.245317 5954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:10.245761 5946 server_base.cc:1034] running on GCE node
I20260808 05:07:10.245980 5946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:10.246202 5946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:10.247356 5946 hybrid_clock.cc:648] HybridClock initialized: now 1786165630247342 us; error 29 us; skew 500 ppm
Aug 08 05:07:10 dist-test-slave-7kzw krb5kdc[5402](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165630, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:10.249995 5946 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:07:10.250504 5946 webserver.cc:460] Webserver started at http://127.11.70.195:34235/ using document root <none> and password file <none>
I20260808 05:07:10.250777 5946 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:10.250825 5946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:10.250979 5946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:10.252058 5946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "f605581a9aff45878e84edb5a3b42ae1"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "878373aa9a3196842370e24359cc86e4"
server_key_iv: "76ca6773bf221e4c3a8768bd7519621c"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.252439 5946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "f605581a9aff45878e84edb5a3b42ae1"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "878373aa9a3196842370e24359cc86e4"
server_key_iv: "76ca6773bf221e4c3a8768bd7519621c"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.253886 5946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:10.254810 5963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.255020 5946 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:10.255100 5946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "f605581a9aff45878e84edb5a3b42ae1"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "878373aa9a3196842370e24359cc86e4"
server_key_iv: "76ca6773bf221e4c3a8768bd7519621c"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.255198 5946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:10.267405 5946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:10.269620 5946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:10.269776 5946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:10.270053 5946 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:10.270399 5946 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:10.270434 5946 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.270499 5946 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:10.270524 5946 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.276504 5946 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:35645
I20260808 05:07:10.276587 6118 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:35645 every 8 connection(s)
I20260808 05:07:10.276937 5946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:07:10.283275 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 5946
I20260808 05:07:10.283393 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:07:10.283577 11547 external_mini_cluster.cc:1428] Setting key ada95980b01bbcae095ac86973e6acce
Aug 08 05:07:10 dist-test-slave-7kzw krb5kdc[5402](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165630, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:10.287693 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.277790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:42357 (local address 127.11.70.254:39333)
0808 05:07:10.277850 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.277853 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.278041 (+ 188us) server_negotiation.cc:407] Connection header received
0808 05:07:10.278557 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.278559 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.278574 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.278676 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:10.279708 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.280290 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.281360 (+ 1070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.281610 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.281725 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.284470 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:10.284471 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:10.284471 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:10.284479 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:10.286064 (+ 1585us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:10.286533 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:10.286535 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:10.286535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:10.286679 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:10.286977 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:10.286978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:10.286979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:10.287110 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:10.287187 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.287500 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.287599 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:07:10.287914 6122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.277731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:39333 (local address 127.11.70.195:42357)
0808 05:07:10.277908 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.277952 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:10.278443 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:10.278731 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:10.278735 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:10.279331 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:10.279595 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.279600 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.280376 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.280377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.281271 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.281279 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.281722 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.281723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.281840 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.282534 (+ 694us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:10.282544 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:10.284390 (+ 1846us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:10.286141 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:10.286148 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:10.286150 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:10.286384 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:10.286763 (+ 379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:10.286764 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:10.286764 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:10.286893 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:10.287189 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:10.287198 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:10.287357 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 05:07:10.287475 (+ 118us) client_negotiation.cc:240] Negotiation successful
0808 05:07:10.287645 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":97,"threads_started":1}
I20260808 05:07:10.288533 6119 heartbeater.cc:347] Connected to a master server at 127.11.70.254:39333
I20260808 05:07:10.288627 6119 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:10.288834 6119 heartbeater.cc:511] Master 127.11.70.254:39333 requested a full tablet report, sending...
I20260808 05:07:10.289311 5464 ts_manager.cc:194] Registered new tserver with Master: f605581a9aff45878e84edb5a3b42ae1 (127.11.70.195:35645)
I20260808 05:07:10.289705 5464 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:42357
I20260808 05:07:10.295616 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:07:10.304301 5548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.297066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56944 (local address 127.11.70.254:39333)
0808 05:07:10.297169 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.297172 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.297300 (+ 128us) server_negotiation.cc:407] Connection header received
0808 05:07:10.297373 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.297374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.297388 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.297466 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:10.298145 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.298738 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.299574 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.299780 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.299875 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.301363 (+ 1488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:10.301364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:10.301365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:10.301373 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:10.302847 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:10.303324 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:10.303325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:10.303326 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:10.303392 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:10.303688 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:10.303689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:10.303689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:10.303846 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:10.303982 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.304112 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.304182 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260808 05:07:10.306077 5464 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56944:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:07:10.307833 5464 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:07:10.314577 6133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.310346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:35645 (local address 127.0.0.1:42112)
0808 05:07:10.310527 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.310573 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:10.310643 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:10.311077 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:10.311081 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:10.311083 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:10.311168 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.311172 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.312231 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.312232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.313439 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.313441 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.314247 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.314248 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.314331 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.314345 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:07:10.314420 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:07:10.314496 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":5,"thread_start_us":103,"threads_started":1}
I20260808 05:07:10.314589 6147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.310655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42112 (local address 127.11.70.195:35645)
0808 05:07:10.310851 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.310855 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.310870 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:07:10.310919 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.310922 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.310941 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.311258 (+ 317us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:10.311329 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.312116 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.313537 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.314147 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.314238 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.314301 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.314443 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.314504 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":104,"threads_started":1}
I20260808 05:07:10.314913 6144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.310562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:35593 (local address 127.0.0.1:42706)
0808 05:07:10.310999 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.311011 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:10.311059 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:10.311384 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:10.311385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:10.311387 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:10.311425 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.311427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.312691 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.312692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.313705 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.313707 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.314677 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.314678 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.314750 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.314756 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:07:10.314803 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 05:07:10.314840 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":415,"thread_start_us":70,"threads_started":1}
I20260808 05:07:10.315171 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.310807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42706 (local address 127.11.70.194:35593)
0808 05:07:10.311003 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.311008 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.311154 (+ 146us) server_negotiation.cc:407] Connection header received
0808 05:07:10.311201 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.311203 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.311220 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.311292 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:10.311515 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.312586 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.313800 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.314518 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.314585 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.314643 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.315018 (+ 375us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.315085 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":95,"threads_started":1}
I20260808 05:07:10.315433 6134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.310334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:46575 (local address 127.0.0.1:54752)
0808 05:07:10.310527 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.310573 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:10.310643 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:10.311096 (+ 453us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:10.311097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:10.311100 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:10.311168 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.311170 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.312596 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.312598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.313623 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.313625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.314596 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.314597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.315154 (+ 557us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.315158 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:07:10.315200 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 05:07:10.315321 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":3,"thread_start_us":62,"threads_started":1}
I20260808 05:07:10.315423 6024 tablet_service.cc:1467] Processing CreateTablet for tablet 729e6edc86874df2813c18f356c27eae (DEFAULT_TABLE table=test-table [id=ff5c8a5a00d943088f47bb6486061dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:10.315850 6024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 729e6edc86874df2813c18f356c27eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:10.315867 6138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.310434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54752 (local address 127.11.70.193:46575)
0808 05:07:10.310897 (+ 463us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.310903 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.310915 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:07:10.310957 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.310960 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.310977 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.311263 (+ 286us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:10.311346 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.312485 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.313707 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.314435 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.315658 (+ 1223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.315731 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.315756 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.315803 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":422,"thread_start_us":110,"threads_started":1}
I20260808 05:07:10.315840 5840 tablet_service.cc:1467] Processing CreateTablet for tablet 729e6edc86874df2813c18f356c27eae (DEFAULT_TABLE table=test-table [id=ff5c8a5a00d943088f47bb6486061dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:10.316192 5840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 729e6edc86874df2813c18f356c27eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:10.319123 5649 tablet_service.cc:1467] Processing CreateTablet for tablet 729e6edc86874df2813c18f356c27eae (DEFAULT_TABLE table=test-table [id=ff5c8a5a00d943088f47bb6486061dee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:10.319487 5649 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 729e6edc86874df2813c18f356c27eae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:10.319734 6150 tablet_bootstrap.cc:492] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: Bootstrap starting.
I20260808 05:07:10.320497 6150 tablet_bootstrap.cc:654] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:10.321199 6150 log.cc:824] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:10.319487 6149 tablet_bootstrap.cc:492] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: Bootstrap starting.
I20260808 05:07:10.322171 6150 tablet_bootstrap.cc:492] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: No bootstrap required, opened a new log
I20260808 05:07:10.322191 6149 tablet_bootstrap.cc:654] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:10.322284 6150 ts_tablet_manager.cc:1397] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:07:10.322919 6149 log.cc:824] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:10.323943 6149 tablet_bootstrap.cc:492] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: No bootstrap required, opened a new log
I20260808 05:07:10.324009 6149 ts_tablet_manager.cc:1397] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260808 05:07:10.324405 6150 raft_consensus.cc:348] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } }
I20260808 05:07:10.324587 6150 raft_consensus.cc:374] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:10.324641 6150 raft_consensus.cc:729] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21b90799dc794bed8478c55fd18b2896, State: Initialized, Role: FOLLOWER
I20260808 05:07:10.324795 6150 consensus_queue.cc:260] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } }
I20260808 05:07:10.325127 6150 ts_tablet_manager.cc:1428] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:10.325129 5938 heartbeater.cc:503] Master 127.11.70.254:39333 was elected leader, sending a full tablet report...
I20260808 05:07:10.325800 6149 raft_consensus.cc:348] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } }
I20260808 05:07:10.325985 6149 raft_consensus.cc:374] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:10.326048 6149 raft_consensus.cc:729] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f605581a9aff45878e84edb5a3b42ae1, State: Initialized, Role: FOLLOWER
I20260808 05:07:10.326186 6149 consensus_queue.cc:260] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } }
I20260808 05:07:10.326537 6119 heartbeater.cc:503] Master 127.11.70.254:39333 was elected leader, sending a full tablet report...
I20260808 05:07:10.326575 6149 ts_tablet_manager.cc:1428] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 05:07:10.326810 6153 tablet_bootstrap.cc:492] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574: Bootstrap starting.
I20260808 05:07:10.327564 6153 tablet_bootstrap.cc:654] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:10.328145 6153 log.cc:824] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:10.328960 6153 tablet_bootstrap.cc:492] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574: No bootstrap required, opened a new log
I20260808 05:07:10.329170 6153 ts_tablet_manager.cc:1397] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:10.330804 6153 raft_consensus.cc:348] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } }
I20260808 05:07:10.330981 6153 raft_consensus.cc:374] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:10.331139 6153 raft_consensus.cc:729] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bd18ea5b2a04ce48cd783ed38a05574, State: Initialized, Role: FOLLOWER
I20260808 05:07:10.331287 6153 consensus_queue.cc:260] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } }
I20260808 05:07:10.331627 6153 ts_tablet_manager.cc:1428] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 05:07:10.331645 5743 heartbeater.cc:503] Master 127.11.70.254:39333 was elected leader, sending a full tablet report...
I20260808 05:07:10.342796 6154 raft_consensus.cc:482] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:07:10.342937 6154 raft_consensus.cc:504] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } }
I20260808 05:07:10.343317 6154 leader_election.cc:288] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2bd18ea5b2a04ce48cd783ed38a05574 (127.11.70.193:46575), f605581a9aff45878e84edb5a3b42ae1 (127.11.70.195:35645)
I20260808 05:07:10.346815 6138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.343642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:43629 (local address 127.11.70.193:46575)
0808 05:07:10.343691 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.343693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.343702 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:10.343731 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.343732 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.343781 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.343838 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:10.344031 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.344557 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.345667 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.346387 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.346499 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.346508 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.346696 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.346739 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:07:10.346815 6147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.343644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:33297 (local address 127.11.70.195:35645)
0808 05:07:10.343709 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.343711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.343756 (+ 45us) server_negotiation.cc:407] Connection header received
0808 05:07:10.343860 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.343861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.343871 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.343947 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:10.344166 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.344739 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.345765 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.346389 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.346498 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.346508 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.346703 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.346747 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:07:10.346817 5940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.343481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:46575 (local address 127.11.70.194:43629)
0808 05:07:10.343547 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.343561 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:10.343629 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:10.343857 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:10.343858 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:10.343860 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:10.343947 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.343949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.344670 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.344671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.345565 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.345568 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.346500 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.346501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.346593 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.346595 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:07:10.346654 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:07:10.346714 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41,"mutex_wait_us":3}
I20260808 05:07:10.346824 6160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.343481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:35645 (local address 127.11.70.194:33297)
0808 05:07:10.343699 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.343710 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:10.343771 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:10.344004 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:10.344006 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:10.344008 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:10.344090 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.344092 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.344826 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.344826 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.345624 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.345627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.346501 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.346502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.346587 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.346591 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:07:10.346654 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 05:07:10.346714 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":88,"thread_start_us":96,"threads_started":1}
I20260808 05:07:10.347209 6050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "729e6edc86874df2813c18f356c27eae" candidate_uuid: "21b90799dc794bed8478c55fd18b2896" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f605581a9aff45878e84edb5a3b42ae1" is_pre_election: true
I20260808 05:07:10.347223 5672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "729e6edc86874df2813c18f356c27eae" candidate_uuid: "21b90799dc794bed8478c55fd18b2896" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" is_pre_election: true
I20260808 05:07:10.347402 5672 raft_consensus.cc:2454] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b90799dc794bed8478c55fd18b2896 in term 0.
I20260808 05:07:10.347402 6050 raft_consensus.cc:2454] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 21b90799dc794bed8478c55fd18b2896 in term 0.
I20260808 05:07:10.347661 5779 leader_election.cc:302] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b90799dc794bed8478c55fd18b2896, 2bd18ea5b2a04ce48cd783ed38a05574; no voters:
I20260808 05:07:10.347869 6154 raft_consensus.cc:2781] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:07:10.347922 6154 raft_consensus.cc:482] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:07:10.347939 6154 raft_consensus.cc:3037] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:10.348682 6154 raft_consensus.cc:504] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } }
I20260808 05:07:10.348834 6154 leader_election.cc:288] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [CANDIDATE]: Term 1 election: Requested vote from peers 2bd18ea5b2a04ce48cd783ed38a05574 (127.11.70.193:46575), f605581a9aff45878e84edb5a3b42ae1 (127.11.70.195:35645)
I20260808 05:07:10.348984 6050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "729e6edc86874df2813c18f356c27eae" candidate_uuid: "21b90799dc794bed8478c55fd18b2896" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f605581a9aff45878e84edb5a3b42ae1"
I20260808 05:07:10.349000 5672 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "729e6edc86874df2813c18f356c27eae" candidate_uuid: "21b90799dc794bed8478c55fd18b2896" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2bd18ea5b2a04ce48cd783ed38a05574"
I20260808 05:07:10.349069 5672 raft_consensus.cc:3037] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:10.349068 6050 raft_consensus.cc:3037] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:10.349963 6050 raft_consensus.cc:2454] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b90799dc794bed8478c55fd18b2896 in term 1.
I20260808 05:07:10.349963 5672 raft_consensus.cc:2454] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 21b90799dc794bed8478c55fd18b2896 in term 1.
I20260808 05:07:10.350183 5779 leader_election.cc:302] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21b90799dc794bed8478c55fd18b2896, 2bd18ea5b2a04ce48cd783ed38a05574; no voters:
I20260808 05:07:10.350328 6154 raft_consensus.cc:2781] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:10.350510 6154 raft_consensus.cc:686] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 1 LEADER]: Becoming Leader. State: Replica: 21b90799dc794bed8478c55fd18b2896, State: Running, Role: LEADER
I20260808 05:07:10.350623 6154 consensus_queue.cc:237] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } }
I20260808 05:07:10.351468 5463 catalog_manager.cc:5495] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 reported cstate change: term changed from 0 to 1, leader changed from <none> to 21b90799dc794bed8478c55fd18b2896 (127.11.70.194). New cstate: current_term: 1 leader_uuid: "21b90799dc794bed8478c55fd18b2896" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21b90799dc794bed8478c55fd18b2896" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 35593 } health_report { overall_health: HEALTHY } } }
W20260808 05:07:10.356499 5939 tablet.cc:2369] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:07:10.360242 6148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.357852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42712 (local address 127.11.70.194:35593)
0808 05:07:10.357908 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.357910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.357948 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:07:10.358013 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.358014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.358029 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.358090 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:10.358204 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.358722 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.359552 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.359729 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.359784 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.359961 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:10.360042 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:10.360109 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.360161 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.360170 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:07:10.361917 5672 raft_consensus.cc:1261] T 729e6edc86874df2813c18f356c27eae P 2bd18ea5b2a04ce48cd783ed38a05574 [term 1 FOLLOWER]: Refusing update from remote peer 21b90799dc794bed8478c55fd18b2896: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:10.361981 6050 raft_consensus.cc:1261] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [term 1 FOLLOWER]: Refusing update from remote peer 21b90799dc794bed8478c55fd18b2896: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:10.362313 6161 consensus_queue.cc:1035] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2bd18ea5b2a04ce48cd783ed38a05574" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 46575 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:10.362511 6154 consensus_queue.cc:1035] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f605581a9aff45878e84edb5a3b42ae1" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 35645 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:10.364950 6169 mvcc.cc:205] Tried to move back new op lower bound from 7316134421959901184 to 7316134421916909568. Current Snapshot: MvccSnapshot[applied={T|T < 7316134421959901184}]
I20260808 05:07:10.365499 6168 mvcc.cc:205] Tried to move back new op lower bound from 7316134421959901184 to 7316134421916909568. Current Snapshot: MvccSnapshot[applied={T|T < 7316134421959901184}]
I20260808 05:07:10.367686 5464 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:10.367790 5464 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56944:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:10.368537 5464 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3a372627b7204274bf807858ae6200e4: Sending DeleteTablet for 3 replicas of tablet 729e6edc86874df2813c18f356c27eae
I20260808 05:07:10.369014 6024 tablet_service.cc:1514] Processing DeleteTablet for tablet 729e6edc86874df2813c18f356c27eae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:10 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:42112
I20260808 05:07:10.369127 5840 tablet_service.cc:1514] Processing DeleteTablet for tablet 729e6edc86874df2813c18f356c27eae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:10 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:42706
I20260808 05:07:10.369274 5649 tablet_service.cc:1514] Processing DeleteTablet for tablet 729e6edc86874df2813c18f356c27eae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:10 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:54752
I20260808 05:07:10.369380 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 5553
I20260808 05:07:10.371747 6182 tablet_replica.cc:330] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: stopping tablet replica
I20260808 05:07:10.371891 6182 raft_consensus.cc:2229] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:07:10.372046 6182 raft_consensus.cc:2258] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:10.374531 6183 tablet_replica.cc:330] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: stopping tablet replica
I20260808 05:07:10.374702 6183 raft_consensus.cc:2229] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:07:10.374733 6182 ts_tablet_manager.cc:1905] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:10.374929 6183 raft_consensus.cc:2258] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:10.375677 6183 ts_tablet_manager.cc:1905] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:10.376591 6182 ts_tablet_manager.cc:1918] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:10.376685 6182 log.cc:1196] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/729e6edc86874df2813c18f356c27eae
I20260808 05:07:10.377007 6182 ts_tablet_manager.cc:1939] T 729e6edc86874df2813c18f356c27eae P f605581a9aff45878e84edb5a3b42ae1: Deleting consensus metadata
I20260808 05:07:10.377501 5443 catalog_manager.cc:4841] TS f605581a9aff45878e84edb5a3b42ae1 (127.11.70.195:35645): tablet 729e6edc86874df2813c18f356c27eae (table test-table [id=ff5c8a5a00d943088f47bb6486061dee]) successfully deleted
I20260808 05:07:10.377759 6183 ts_tablet_manager.cc:1918] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:10.377867 6183 log.cc:1196] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/729e6edc86874df2813c18f356c27eae
I20260808 05:07:10.378201 6183 ts_tablet_manager.cc:1939] T 729e6edc86874df2813c18f356c27eae P 21b90799dc794bed8478c55fd18b2896: Deleting consensus metadata
I20260808 05:07:10.378772 5444 catalog_manager.cc:4841] TS 21b90799dc794bed8478c55fd18b2896 (127.11.70.194:35593): tablet 729e6edc86874df2813c18f356c27eae (table test-table [id=ff5c8a5a00d943088f47bb6486061dee]) successfully deleted
W20260808 05:07:10.393360 5444 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:46575 (error 108)
I20260808 05:07:10.393610 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 5751
I20260808 05:07:10.399549 6134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.399378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:46575 (local address 127.0.0.1:54758)
0808 05:07:10.399447 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.399496 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:46575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 05:07:10.399693 5444 catalog_manager.cc:4584] TS 2bd18ea5b2a04ce48cd783ed38a05574 (127.11.70.193:46575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 729e6edc86874df2813c18f356c27eae: Network error: Client connection negotiation failed: client connection to 127.11.70.193:46575: connect: Connection refused (error 111)
I20260808 05:07:10.406755 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 5946
I20260808 05:07:10.424643 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 5419
2026-08-08T05:07:10Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2239 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T05:07:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:10Z Disabled control of system clock
I20260808 05:07:10.459091 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:35205
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:35695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:35205
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:07:10.542418 6191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:10.542697 6191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:10.542719 6191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:10.543835 6191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:10.543871 6191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:10.543884 6191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:10.543897 6191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:10.543910 6191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:10.545181 6191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:35695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:35205
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:35205
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:10.545393 6191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:10.545643 6191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:10.550750 6201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.550828 6197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.550828 6199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:10.551177 6191 server_base.cc:1034] running on GCE node
I20260808 05:07:10.551482 6191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:10.551815 6191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:10.552992 6191 hybrid_clock.cc:648] HybridClock initialized: now 1786165630552971 us; error 44 us; skew 500 ppm
I20260808 05:07:10.554332 6191 webserver.cc:460] Webserver started at http://127.11.70.254:42273/ using document root <none> and password file <none>
I20260808 05:07:10.554637 6191 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:10.554709 6191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:10.554860 6191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:10.555939 6191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "519efca14cfa4361810209e0fbc81e2e"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "1d85ac1c83fed6421dec3b31021af768"
server_key_iv: "4c4eabf0c1eadbd8f2f4d4f68309660c"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.556319 6191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "519efca14cfa4361810209e0fbc81e2e"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "1d85ac1c83fed6421dec3b31021af768"
server_key_iv: "4c4eabf0c1eadbd8f2f4d4f68309660c"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.557669 6191 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:10.558436 6210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.558682 6191 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:10.558790 6191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "519efca14cfa4361810209e0fbc81e2e"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "1d85ac1c83fed6421dec3b31021af768"
server_key_iv: "4c4eabf0c1eadbd8f2f4d4f68309660c"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.558874 6191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:10.567565 6191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:10.567875 6191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:10.568035 6191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:10.572554 6191 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:35205
I20260808 05:07:10.572598 6285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:35205 every 8 connection(s)
I20260808 05:07:10.572948 6191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:10.573758 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 6191
I20260808 05:07:10.573899 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:10.574193 11547 external_mini_cluster.cc:1428] Setting key 37af8636a9d4fc6837c6111b2830dd42
I20260808 05:07:10.574189 6287 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:10.577710 6287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e: Bootstrap starting.
I20260808 05:07:10.578361 6287 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:10.578734 6287 log.cc:824] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:10.579628 6287 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e: No bootstrap required, opened a new log
I20260808 05:07:10.579885 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.574796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37242 (local address 127.11.70.254:35205)
0808 05:07:10.575011 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.575019 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.575044 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:07:10.575436 (+ 392us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.575442 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.575509 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.575619 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:10.575848 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.576711 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.577822 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.578231 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.578325 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.579125 (+ 800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:10.579129 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:10.579130 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:10.579343 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:10.579384 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:10.579396 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:10.579449 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.579561 (+ 112us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.579650 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":89,"threads_started":1}
I20260808 05:07:10.581697 6287 raft_consensus.cc:348] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "519efca14cfa4361810209e0fbc81e2e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35205 } }
I20260808 05:07:10.581861 6287 raft_consensus.cc:374] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:10.581910 6287 raft_consensus.cc:729] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 519efca14cfa4361810209e0fbc81e2e, State: Initialized, Role: FOLLOWER
I20260808 05:07:10.582036 6287 consensus_queue.cc:260] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "519efca14cfa4361810209e0fbc81e2e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35205 } }
I20260808 05:07:10.582123 6287 raft_consensus.cc:388] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:10.582168 6287 raft_consensus.cc:482] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:10.582217 6287 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:10.582937 6287 raft_consensus.cc:504] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "519efca14cfa4361810209e0fbc81e2e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35205 } }
I20260808 05:07:10.583071 6287 leader_election.cc:302] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 519efca14cfa4361810209e0fbc81e2e; no voters:
I20260808 05:07:10.583271 6287 leader_election.cc:288] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:10.583314 6297 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:10.583499 6297 raft_consensus.cc:686] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [term 1 LEADER]: Becoming Leader. State: Replica: 519efca14cfa4361810209e0fbc81e2e, State: Running, Role: LEADER
I20260808 05:07:10.583556 6287 sys_catalog.cc:564] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:10.583643 6297 consensus_queue.cc:237] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "519efca14cfa4361810209e0fbc81e2e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35205 } }
I20260808 05:07:10.584059 6299 sys_catalog.cc:455] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 519efca14cfa4361810209e0fbc81e2e. Latest consensus state: current_term: 1 leader_uuid: "519efca14cfa4361810209e0fbc81e2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "519efca14cfa4361810209e0fbc81e2e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35205 } } }
I20260808 05:07:10.584157 6299 sys_catalog.cc:458] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:10.584052 6298 sys_catalog.cc:455] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "519efca14cfa4361810209e0fbc81e2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "519efca14cfa4361810209e0fbc81e2e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35205 } } }
I20260808 05:07:10.584403 6308 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:10.585011 6308 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:10.584393 6298 sys_catalog.cc:458] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:10.586658 6308 catalog_manager.cc:1347] Generated new cluster ID: 96c935ccb39d454d92a693e1306ee250
I20260808 05:07:10.586717 6308 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:10.606426 6308 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:10.607184 6308 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:10.613312 6308 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e: Generated new TSK 0
I20260808 05:07:10.613518 6308 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:10.618299 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35205
--builtin_ntp_servers=127.11.70.212:35695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:07:10.705489 6321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:10.705739 6321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:10.705777 6321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:10.706998 6321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:10.707057 6321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:10.707098 6321 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:07:10.708503 6321 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:35695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35205
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:10.708767 6321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:10.709069 6321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:10.714519 6329 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:10.714699 6321 server_base.cc:1034] running on GCE node
W20260808 05:07:10.714531 6332 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.714443 6328 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:10.715070 6321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:10.715349 6321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:10.716523 6321 hybrid_clock.cc:648] HybridClock initialized: now 1786165630716508 us; error 34 us; skew 500 ppm
I20260808 05:07:10.717914 6321 webserver.cc:460] Webserver started at http://127.11.70.193:41731/ using document root <none> and password file <none>
I20260808 05:07:10.718195 6321 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:10.718254 6321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:10.718441 6321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:10.719558 6321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "4782bcdc12b34b678a3a383f6b43b5a4"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "5bb7302908138783376a6e23e3947fc5"
server_key_iv: "3461b21cd22579f540388542fcc83734"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.719933 6321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "4782bcdc12b34b678a3a383f6b43b5a4"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "5bb7302908138783376a6e23e3947fc5"
server_key_iv: "3461b21cd22579f540388542fcc83734"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.721302 6321 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:10.722111 6340 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.722332 6321 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:10.722443 6321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "4782bcdc12b34b678a3a383f6b43b5a4"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "5bb7302908138783376a6e23e3947fc5"
server_key_iv: "3461b21cd22579f540388542fcc83734"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.722574 6321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:10.734382 6321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:10.734758 6321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:10.734944 6321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:10.735198 6321 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:10.735541 6321 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:10.735576 6321 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.735599 6321 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:10.735611 6321 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.741559 6321 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:44207
I20260808 05:07:10.741609 6490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:44207 every 8 connection(s)
I20260808 05:07:10.741945 6321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:07:10.745045 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 6321
I20260808 05:07:10.745186 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:07:10.745391 11547 external_mini_cluster.cc:1428] Setting key 719d1a032239ada91d404409c9be55ef
I20260808 05:07:10.746322 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35205
--builtin_ntp_servers=127.11.70.212:35695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:07:10.747496 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.742720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:58913 (local address 127.11.70.254:35205)
0808 05:07:10.742801 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.742803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.743039 (+ 236us) server_negotiation.cc:407] Connection header received
0808 05:07:10.743512 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.743513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.743525 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.743579 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:10.744220 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.744713 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.745826 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.746036 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.746126 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.747103 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:10.747105 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:10.747105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:10.747111 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:10.747131 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:10.747136 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:10.747199 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.747309 (+ 110us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.747346 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:07:10.747584 6494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.742722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:35205 (local address 127.11.70.193:58913)
0808 05:07:10.742911 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.742945 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:10.743429 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:10.743630 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:10.743633 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:10.743641 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:10.744148 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.744152 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.744802 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.744803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.745732 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.745735 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.746140 (+ 405us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.746141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.746285 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.746936 (+ 651us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:07:10.746936 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:10.746976 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:07:10.747005 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:10.747208 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:10.747213 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:10.747216 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:10.747305 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:07:10.747391 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":101,"threads_started":1}
I20260808 05:07:10.748128 6491 heartbeater.cc:347] Connected to a master server at 127.11.70.254:35205
I20260808 05:07:10.748242 6491 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:10.748466 6491 heartbeater.cc:511] Master 127.11.70.254:35205 requested a full tablet report, sending...
I20260808 05:07:10.749006 6236 ts_manager.cc:194] Registered new tserver with Master: 4782bcdc12b34b678a3a383f6b43b5a4 (127.11.70.193:44207)
I20260808 05:07:10.749662 6236 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.193:58913
W20260808 05:07:10.832736 6495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:10.832991 6495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:10.833029 6495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:10.834159 6495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:10.834223 6495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:10.834278 6495 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:07:10.835696 6495 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:35695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35205
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6495
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:10.835963 6495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:10.836277 6495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:10.841444 6502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.841440 6507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.841495 6503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:10.841637 6495 server_base.cc:1034] running on GCE node
I20260808 05:07:10.841970 6495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:10.842229 6495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:10.843412 6495 hybrid_clock.cc:648] HybridClock initialized: now 1786165630843397 us; error 28 us; skew 500 ppm
I20260808 05:07:10.844650 6495 webserver.cc:460] Webserver started at http://127.11.70.194:38003/ using document root <none> and password file <none>
I20260808 05:07:10.844897 6495 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:10.844969 6495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:10.845132 6495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:10.846168 6495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "dfd2f78bc109496cb5ba0693baff5fbc"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "476684a54898a0121b37f1410b253fb9"
server_key_iv: "e6772d8cac443610883676cc4aea9218"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.846628 6495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "dfd2f78bc109496cb5ba0693baff5fbc"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "476684a54898a0121b37f1410b253fb9"
server_key_iv: "e6772d8cac443610883676cc4aea9218"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.847992 6495 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:10.848775 6517 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.848950 6495 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:10.849064 6495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "dfd2f78bc109496cb5ba0693baff5fbc"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "476684a54898a0121b37f1410b253fb9"
server_key_iv: "e6772d8cac443610883676cc4aea9218"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.849153 6495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:10.874104 6495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:10.874480 6495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:10.874651 6495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:10.874931 6495 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:10.875308 6495 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:10.875365 6495 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.875403 6495 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:10.875450 6495 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.881510 6495 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:42923
I20260808 05:07:10.881560 6677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:42923 every 8 connection(s)
I20260808 05:07:10.881903 6495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:07:10.883639 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 6495
I20260808 05:07:10.883801 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:07:10.884042 11547 external_mini_cluster.cc:1428] Setting key 6d4cae8f62b28a38311ddb6b210f1593
I20260808 05:07:10.885825 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35205
--builtin_ntp_servers=127.11.70.212:35695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:07:10.888427 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.882747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:56403 (local address 127.11.70.254:35205)
0808 05:07:10.882836 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:10.882838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:10.883069 (+ 231us) server_negotiation.cc:407] Connection header received
0808 05:07:10.883739 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:10.883741 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:10.883756 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:10.883836 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:10.884848 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.885608 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.886766 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.887067 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.887144 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.888098 (+ 954us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:10.888100 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:10.888100 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:10.888106 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:10.888125 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:10.888130 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:10.888195 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:10.888280 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 05:07:10.888316 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:07:10.888537 6681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:10.882708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:35205 (local address 127.11.70.194:56403)
0808 05:07:10.882906 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:10.882942 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:10.883632 (+ 690us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:10.883966 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:10.883970 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:10.883978 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:10.884742 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.884749 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.885700 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.885701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.886683 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:10.886686 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:10.887162 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:10.887163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:10.887290 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:10.887945 (+ 655us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:07:10.887946 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:10.887976 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:07:10.888000 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:10.888202 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:10.888207 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:10.888209 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:07:10.888262 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 05:07:10.888340 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260808 05:07:10.889384 6678 heartbeater.cc:347] Connected to a master server at 127.11.70.254:35205
I20260808 05:07:10.889480 6678 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:10.889679 6678 heartbeater.cc:511] Master 127.11.70.254:35205 requested a full tablet report, sending...
I20260808 05:07:10.890082 6236 ts_manager.cc:194] Registered new tserver with Master: dfd2f78bc109496cb5ba0693baff5fbc (127.11.70.194:42923)
I20260808 05:07:10.890671 6236 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.194:56403
W20260808 05:07:10.972416 6682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:10.972632 6682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:10.972654 6682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:10.973730 6682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:10.973762 6682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:10.973788 6682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:07:10.975147 6682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:35695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35205
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:10.975339 6682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:10.975586 6682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:10.980619 6693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.980767 6692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:10.980640 6695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:10.980854 6682 server_base.cc:1034] running on GCE node
I20260808 05:07:10.981086 6682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:10.981331 6682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:10.982522 6682 hybrid_clock.cc:648] HybridClock initialized: now 1786165630982504 us; error 32 us; skew 500 ppm
I20260808 05:07:10.983952 6682 webserver.cc:460] Webserver started at http://127.11.70.195:39353/ using document root <none> and password file <none>
I20260808 05:07:10.984200 6682 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:10.984270 6682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:10.984437 6682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:10.985525 6682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "18984c5592634ebabfcff29d79c09f6b"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "0887525faff04423f9d112a7038e46f8"
server_key_iv: "f358bdeed7269e2000a08df8a1a0a2be"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.985901 6682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "18984c5592634ebabfcff29d79c09f6b"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "0887525faff04423f9d112a7038e46f8"
server_key_iv: "f358bdeed7269e2000a08df8a1a0a2be"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.987406 6682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:10.988270 6704 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:10.988474 6682 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:10.988584 6682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "18984c5592634ebabfcff29d79c09f6b"
format_stamp: "Formatted at 2026-08-08 05:07:10 on dist-test-slave-7kzw"
server_key: "0887525faff04423f9d112a7038e46f8"
server_key_iv: "f358bdeed7269e2000a08df8a1a0a2be"
server_key_version: "encryptionkey@0"
I20260808 05:07:10.988662 6682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:11.004609 6682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:11.004981 6682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:11.005146 6682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:11.005452 6682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:11.005892 6682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:11.005945 6682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:11.005976 6682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:11.005993 6682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:11.012786 6682 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:46731
I20260808 05:07:11.012884 6872 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:46731 every 8 connection(s)
I20260808 05:07:11.013209 6682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:07:11.018610 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.013960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:41667 (local address 127.11.70.254:35205)
0808 05:07:11.014044 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:11.014047 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:11.014281 (+ 234us) server_negotiation.cc:407] Connection header received
0808 05:07:11.014846 (+ 565us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:11.014848 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:11.014859 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:11.014913 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:11.015568 (+ 655us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.016055 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.017123 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.017312 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.017364 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.018346 (+ 982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:11.018347 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:11.018347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:11.018351 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:11.018363 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:11.018366 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:11.018403 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:11.018512 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 05:07:11.018537 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:07:11.018853 6877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.013923 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:35205 (local address 127.11.70.195:41667)
0808 05:07:11.014145 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:11.014180 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:11.014755 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:11.014966 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:11.014969 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:11.014977 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:11.015498 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.015503 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.016164 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.016165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.017036 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.017039 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.017423 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.017424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.017562 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.018212 (+ 650us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:07:11.018213 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:11.018246 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:07:11.018270 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:11.018405 (+ 135us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:11.018408 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:11.018411 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:11.018456 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:07:11.018591 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":102,"threads_started":1}
I20260808 05:07:11.019397 6873 heartbeater.cc:347] Connected to a master server at 127.11.70.254:35205
I20260808 05:07:11.019506 6873 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:11.019692 6873 heartbeater.cc:511] Master 127.11.70.254:35205 requested a full tablet report, sending...
I20260808 05:07:11.020110 6236 ts_manager.cc:194] Registered new tserver with Master: 18984c5592634ebabfcff29d79c09f6b (127.11.70.195:46731)
I20260808 05:07:11.020484 6236 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.195:41667
I20260808 05:07:11.022784 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 6682
I20260808 05:07:11.022897 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:07:11.023108 11547 external_mini_cluster.cc:1428] Setting key 22ad787585da6e09d3fb388d29a46cd2
I20260808 05:07:11.024049 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:07:11.028509 6291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.025556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37258 (local address 127.11.70.254:35205)
0808 05:07:11.025610 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:11.025612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:11.025704 (+ 92us) server_negotiation.cc:407] Connection header received
0808 05:07:11.025806 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:11.025807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:11.025819 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:11.025855 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:11.026042 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.026568 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.027364 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.027544 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.027598 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.028273 (+ 675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:11.028275 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:11.028275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:11.028279 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:11.028292 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:11.028296 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:11.028373 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:11.028442 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 05:07:11.028452 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:07:11.030212 6236 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37258:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:07:11.031824 6236 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:07:11.038501 6893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.034522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47116 (local address 127.11.70.194:42923)
0808 05:07:11.034729 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:11.034732 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:11.034865 (+ 133us) server_negotiation.cc:407] Connection header received
0808 05:07:11.034912 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:11.034914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:11.034928 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:11.035001 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:11.035175 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.036329 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.037517 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.038023 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.038110 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.038201 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:11.038342 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 05:07:11.038387 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":99,"threads_started":1}
I20260808 05:07:11.038546 6894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.034548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55800 (local address 127.11.70.193:44207)
0808 05:07:11.034714 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:11.034719 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:11.034730 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:07:11.034775 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:11.034777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:11.034796 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:11.034876 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:11.035157 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.035900 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.037255 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.038016 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.038095 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.038183 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:11.038378 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 05:07:11.038419 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":96,"threads_started":1}
I20260808 05:07:11.038470 6887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.034375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:42923 (local address 127.0.0.1:47116)
0808 05:07:11.034779 (+ 404us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:11.034789 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:11.034850 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:11.035063 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:11.035064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:11.035066 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:11.035095 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.035097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.036427 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.036428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.037429 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.037431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.038125 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.038126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.038206 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.038220 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:07:11.038322 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 05:07:11.038389 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":25,"thread_start_us":335,"threads_started":1}
I20260808 05:07:11.038697 6889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.034136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:44207 (local address 127.0.0.1:55800)
0808 05:07:11.034336 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:11.034403 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:11.034471 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:11.034983 (+ 512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:11.034987 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:11.034989 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:11.035068 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.035070 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.036003 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.036004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.037175 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.037177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.038219 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.038221 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.038279 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.038283 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:07:11.038333 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:07:11.038550 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"mutex_wait_us":176,"thread_start_us":84,"threads_started":1}
I20260808 05:07:11.039413 6586 tablet_service.cc:1467] Processing CreateTablet for tablet 54c42a4491164b0a9c0cd9268a8af87f (DEFAULT_TABLE table=test-table [id=1993e1c71ad64c31b47467f1b86f775b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:11.039422 6406 tablet_service.cc:1467] Processing CreateTablet for tablet 54c42a4491164b0a9c0cd9268a8af87f (DEFAULT_TABLE table=test-table [id=1993e1c71ad64c31b47467f1b86f775b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:11.039659 6892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.034168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:46731 (local address 127.0.0.1:42342)
0808 05:07:11.034522 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:11.034534 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:11.034585 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:11.034999 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:11.035000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:11.035003 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:11.035083 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.035085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.036456 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.036457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.037464 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.037468 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.039160 (+ 1692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.039161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.039426 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.039431 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:07:11.039480 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:07:11.039555 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":335,"mutex_wait_us":2,"thread_start_us":96,"threads_started":1}
I20260808 05:07:11.039817 6586 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54c42a4491164b0a9c0cd9268a8af87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:11.039817 6406 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54c42a4491164b0a9c0cd9268a8af87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:11.039988 6891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.034269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42342 (local address 127.11.70.195:46731)
0808 05:07:11.034797 (+ 528us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:11.034800 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:11.034808 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:07:11.034867 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:11.034869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:11.034885 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:11.035167 (+ 282us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:11.035229 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.036354 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.037576 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.038523 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.039156 (+ 633us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.039256 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:11.039842 (+ 586us) server_negotiation.cc:299] Negotiation successful
0808 05:07:11.039891 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":116,"threads_started":1}
I20260808 05:07:11.040551 6779 tablet_service.cc:1467] Processing CreateTablet for tablet 54c42a4491164b0a9c0cd9268a8af87f (DEFAULT_TABLE table=test-table [id=1993e1c71ad64c31b47467f1b86f775b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:11.040875 6779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 54c42a4491164b0a9c0cd9268a8af87f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:11.043393 6899 tablet_bootstrap.cc:492] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: Bootstrap starting.
I20260808 05:07:11.043771 6900 tablet_bootstrap.cc:492] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: Bootstrap starting.
I20260808 05:07:11.044090 6899 tablet_bootstrap.cc:654] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:11.044400 6900 tablet_bootstrap.cc:654] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:11.044405 6899 log.cc:824] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:11.044696 6900 log.cc:824] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:11.044803 6896 tablet_bootstrap.cc:492] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4: Bootstrap starting.
I20260808 05:07:11.045301 6899 tablet_bootstrap.cc:492] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: No bootstrap required, opened a new log
I20260808 05:07:11.045377 6899 ts_tablet_manager.cc:1397] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:07:11.045456 6900 tablet_bootstrap.cc:492] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: No bootstrap required, opened a new log
I20260808 05:07:11.045504 6896 tablet_bootstrap.cc:654] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:11.045550 6900 ts_tablet_manager.cc:1397] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:07:11.045840 6896 log.cc:824] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:11.046730 6896 tablet_bootstrap.cc:492] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4: No bootstrap required, opened a new log
I20260808 05:07:11.046804 6896 ts_tablet_manager.cc:1397] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:11.047798 6900 raft_consensus.cc:348] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } }
I20260808 05:07:11.047958 6900 raft_consensus.cc:374] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:11.048005 6900 raft_consensus.cc:729] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18984c5592634ebabfcff29d79c09f6b, State: Initialized, Role: FOLLOWER
I20260808 05:07:11.048121 6900 consensus_queue.cc:260] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } }
I20260808 05:07:11.048179 6899 raft_consensus.cc:348] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } }
I20260808 05:07:11.048346 6899 raft_consensus.cc:374] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:11.048393 6899 raft_consensus.cc:729] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfd2f78bc109496cb5ba0693baff5fbc, State: Initialized, Role: FOLLOWER
I20260808 05:07:11.048427 6900 ts_tablet_manager.cc:1428] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:11.048522 6899 consensus_queue.cc:260] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } }
I20260808 05:07:11.048578 6873 heartbeater.cc:503] Master 127.11.70.254:35205 was elected leader, sending a full tablet report...
I20260808 05:07:11.048784 6899 ts_tablet_manager.cc:1428] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 05:07:11.048830 6678 heartbeater.cc:503] Master 127.11.70.254:35205 was elected leader, sending a full tablet report...
I20260808 05:07:11.049625 6896 raft_consensus.cc:348] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } }
I20260808 05:07:11.049810 6896 raft_consensus.cc:374] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:11.049877 6896 raft_consensus.cc:729] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4782bcdc12b34b678a3a383f6b43b5a4, State: Initialized, Role: FOLLOWER
I20260808 05:07:11.049999 6896 consensus_queue.cc:260] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } }
I20260808 05:07:11.050264 6896 ts_tablet_manager.cc:1428] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260808 05:07:11.050336 6491 heartbeater.cc:503] Master 127.11.70.254:35205 was elected leader, sending a full tablet report...
I20260808 05:07:11.117934 6906 raft_consensus.cc:482] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:07:11.118081 6906 raft_consensus.cc:504] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } }
I20260808 05:07:11.118643 6906 leader_election.cc:288] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4782bcdc12b34b678a3a383f6b43b5a4 (127.11.70.193:44207), dfd2f78bc109496cb5ba0693baff5fbc (127.11.70.194:42923)
I20260808 05:07:11.121942 6877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.118949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:44207 (local address 127.11.70.195:39505)
0808 05:07:11.119033 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:11.119048 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:11.119106 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:11.119295 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:11.119297 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:11.119299 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:11.119388 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.119391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.120149 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.120150 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.121005 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.121007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.121624 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.121626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.121716 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.121719 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:11.121807 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 05:07:11.121858 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 05:07:11.121942 6894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.119065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:39505 (local address 127.11.70.193:44207)
0808 05:07:11.119125 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:11.119128 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:11.119140 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:07:11.119183 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:11.119184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:11.119198 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:11.119284 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:11.119484 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.120045 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.121119 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.121530 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.121627 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.121636 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:11.121818 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 05:07:11.121861 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:07:11.122429 6893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.119206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:58533 (local address 127.11.70.194:42923)
0808 05:07:11.119292 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:11.119294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:11.119429 (+ 135us) server_negotiation.cc:407] Connection header received
0808 05:07:11.119512 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:11.119513 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:11.119529 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:11.119607 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:11.119808 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.120380 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.121498 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.121920 (+ 422us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.122060 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.122070 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:11.122318 (+ 248us) server_negotiation.cc:299] Negotiation successful
0808 05:07:11.122373 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260808 05:07:11.122457 6910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.119130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:42923 (local address 127.11.70.195:58533)
0808 05:07:11.119336 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:11.119347 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:11.119440 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:11.119616 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:11.119617 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:11.119618 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:11.119717 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.119719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.120521 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.120523 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.121379 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:11.121381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.122122 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.122123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:11.122218 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.122223 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:07:11.122299 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:07:11.122351 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":122,"threads_started":1}
I20260808 05:07:11.122438 6433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54c42a4491164b0a9c0cd9268a8af87f" candidate_uuid: "18984c5592634ebabfcff29d79c09f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" is_pre_election: true
I20260808 05:07:11.122705 6433 raft_consensus.cc:2454] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18984c5592634ebabfcff29d79c09f6b in term 0.
I20260808 05:07:11.122957 6614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54c42a4491164b0a9c0cd9268a8af87f" candidate_uuid: "18984c5592634ebabfcff29d79c09f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" is_pre_election: true
I20260808 05:07:11.123027 6706 leader_election.cc:302] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18984c5592634ebabfcff29d79c09f6b, 4782bcdc12b34b678a3a383f6b43b5a4; no voters:
I20260808 05:07:11.123167 6614 raft_consensus.cc:2454] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18984c5592634ebabfcff29d79c09f6b in term 0.
I20260808 05:07:11.123229 6906 raft_consensus.cc:2781] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:07:11.123340 6906 raft_consensus.cc:482] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:07:11.123368 6906 raft_consensus.cc:3037] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:11.124172 6906 raft_consensus.cc:504] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } }
I20260808 05:07:11.124302 6906 leader_election.cc:288] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [CANDIDATE]: Term 1 election: Requested vote from peers 4782bcdc12b34b678a3a383f6b43b5a4 (127.11.70.193:44207), dfd2f78bc109496cb5ba0693baff5fbc (127.11.70.194:42923)
I20260808 05:07:11.124528 6433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54c42a4491164b0a9c0cd9268a8af87f" candidate_uuid: "18984c5592634ebabfcff29d79c09f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4782bcdc12b34b678a3a383f6b43b5a4"
I20260808 05:07:11.124578 6614 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "54c42a4491164b0a9c0cd9268a8af87f" candidate_uuid: "18984c5592634ebabfcff29d79c09f6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dfd2f78bc109496cb5ba0693baff5fbc"
I20260808 05:07:11.124627 6433 raft_consensus.cc:3037] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:11.124712 6614 raft_consensus.cc:3037] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:11.125593 6433 raft_consensus.cc:2454] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18984c5592634ebabfcff29d79c09f6b in term 1.
I20260808 05:07:11.125787 6614 raft_consensus.cc:2454] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18984c5592634ebabfcff29d79c09f6b in term 1.
I20260808 05:07:11.125805 6706 leader_election.cc:302] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18984c5592634ebabfcff29d79c09f6b, 4782bcdc12b34b678a3a383f6b43b5a4; no voters:
I20260808 05:07:11.125898 6906 raft_consensus.cc:2781] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:11.126070 6906 raft_consensus.cc:686] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 1 LEADER]: Becoming Leader. State: Replica: 18984c5592634ebabfcff29d79c09f6b, State: Running, Role: LEADER
I20260808 05:07:11.126210 6906 consensus_queue.cc:237] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } }
I20260808 05:07:11.127220 6235 catalog_manager.cc:5495] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b reported cstate change: term changed from 0 to 1, leader changed from <none> to 18984c5592634ebabfcff29d79c09f6b (127.11.70.195). New cstate: current_term: 1 leader_uuid: "18984c5592634ebabfcff29d79c09f6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18984c5592634ebabfcff29d79c09f6b" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 46731 } health_report { overall_health: HEALTHY } } }
W20260808 05:07:11.132412 6680 tablet.cc:2369] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:07:11.156493 6891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.153376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42356 (local address 127.11.70.195:46731)
0808 05:07:11.153505 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:11.153507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:11.153517 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:07:11.153601 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:11.153602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:11.153630 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:11.153706 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:11.153938 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.154451 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.155593 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:11.155857 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:11.155931 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:11.156100 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:11.156195 (+ 95us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:11.156277 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:11.156323 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 05:07:11.156331 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
I20260808 05:07:11.158664 6614 raft_consensus.cc:1261] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [term 1 FOLLOWER]: Refusing update from remote peer 18984c5592634ebabfcff29d79c09f6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:11.158682 6433 raft_consensus.cc:1261] T 54c42a4491164b0a9c0cd9268a8af87f P 4782bcdc12b34b678a3a383f6b43b5a4 [term 1 FOLLOWER]: Refusing update from remote peer 18984c5592634ebabfcff29d79c09f6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:11.159137 6912 consensus_queue.cc:1035] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "dfd2f78bc109496cb5ba0693baff5fbc" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 42923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:11.159294 6906 consensus_queue.cc:1035] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "4782bcdc12b34b678a3a383f6b43b5a4" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 44207 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:11.162155 6919 mvcc.cc:205] Tried to move back new op lower bound from 7316134425222705152 to 7316134425094041600. Current Snapshot: MvccSnapshot[applied={T|T < 7316134425222705152}]
I20260808 05:07:11.162427 6920 mvcc.cc:205] Tried to move back new op lower bound from 7316134425222705152 to 7316134425094041600. Current Snapshot: MvccSnapshot[applied={T|T < 7316134425222705152}]
I20260808 05:07:11.163179 6921 mvcc.cc:205] Tried to move back new op lower bound from 7316134425222705152 to 7316134425094041600. Current Snapshot: MvccSnapshot[applied={T|T < 7316134425222705152}]
I20260808 05:07:11.165099 6236 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:11.165195 6236 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37258:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:11.165994 6236 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 519efca14cfa4361810209e0fbc81e2e: Sending DeleteTablet for 3 replicas of tablet 54c42a4491164b0a9c0cd9268a8af87f
I20260808 05:07:11.166323 6406 tablet_service.cc:1514] Processing DeleteTablet for tablet 54c42a4491164b0a9c0cd9268a8af87f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:11 UTC) from {username='slave'} at 127.0.0.1:55800
I20260808 05:07:11.166375 6586 tablet_service.cc:1514] Processing DeleteTablet for tablet 54c42a4491164b0a9c0cd9268a8af87f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:11 UTC) from {username='slave'} at 127.0.0.1:47116
I20260808 05:07:11.166426 6779 tablet_service.cc:1514] Processing DeleteTablet for tablet 54c42a4491164b0a9c0cd9268a8af87f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:11 UTC) from {username='slave'} at 127.0.0.1:42342
I20260808 05:07:11.166755 6934 tablet_replica.cc:330] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: stopping tablet replica
I20260808 05:07:11.166850 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 6321
I20260808 05:07:11.166888 6934 raft_consensus.cc:2229] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:07:11.178930 6934 raft_consensus.cc:2258] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:11.179349 6933 tablet_replica.cc:330] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: stopping tablet replica
I20260808 05:07:11.179515 6933 raft_consensus.cc:2229] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:07:11.179657 6933 raft_consensus.cc:2258] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:11.179659 6934 ts_tablet_manager.cc:1905] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:11.181677 6934 ts_tablet_manager.cc:1918] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:11.181780 6934 log.cc:1196] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/54c42a4491164b0a9c0cd9268a8af87f
I20260808 05:07:11.181800 6933 ts_tablet_manager.cc:1905] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:11.182044 6934 ts_tablet_manager.cc:1939] T 54c42a4491164b0a9c0cd9268a8af87f P 18984c5592634ebabfcff29d79c09f6b: Deleting consensus metadata
I20260808 05:07:11.182528 6214 catalog_manager.cc:4841] TS 18984c5592634ebabfcff29d79c09f6b (127.11.70.195:46731): tablet 54c42a4491164b0a9c0cd9268a8af87f (table test-table [id=1993e1c71ad64c31b47467f1b86f775b]) successfully deleted
I20260808 05:07:11.183949 6933 ts_tablet_manager.cc:1918] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:11.184042 6933 log.cc:1196] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/54c42a4491164b0a9c0cd9268a8af87f
I20260808 05:07:11.184345 6933 ts_tablet_manager.cc:1939] T 54c42a4491164b0a9c0cd9268a8af87f P dfd2f78bc109496cb5ba0693baff5fbc: Deleting consensus metadata
I20260808 05:07:11.184948 6211 catalog_manager.cc:4841] TS dfd2f78bc109496cb5ba0693baff5fbc (127.11.70.194:42923): tablet 54c42a4491164b0a9c0cd9268a8af87f (table test-table [id=1993e1c71ad64c31b47467f1b86f775b]) successfully deleted
W20260808 05:07:11.185181 6211 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:44207 (error 108)
I20260808 05:07:11.185765 6892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:11.185568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:44207 (local address 127.0.0.1:55802)
0808 05:07:11.185638 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:11.185687 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:44207: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 05:07:11.185890 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 6495
W20260808 05:07:11.185890 6211 catalog_manager.cc:4584] TS 4782bcdc12b34b678a3a383f6b43b5a4 (127.11.70.193:44207): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 54c42a4491164b0a9c0cd9268a8af87f: Network error: Client connection negotiation failed: client connection to 127.11.70.193:44207: connect: Connection refused (error 111)
I20260808 05:07:11.196115 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 6682
I20260808 05:07:11.205138 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 6191
2026-08-08T05:07:11Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (780 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:11 dist-test-slave-7kzw krb5kdc[6938](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:11 dist-test-slave-7kzw krb5kdc[6938](info): set up 2 sockets
Aug 08 05:07:11 dist-test-slave-7kzw krb5kdc[6938](info): commencing operation
krb5kdc: starting...
W20260808 05:07:12.461896 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.232s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:12 dist-test-slave-7kzw krb5kdc[6938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:12.598038 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43551
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:33929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:43551
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:12.683307 6958 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:12.683565 6958 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:12.683604 6958 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:12.684773 6958 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:12.684844 6958 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:12.684867 6958 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:12.684890 6958 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:12.684919 6958 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:12.686430 6958 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:33929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:43551
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43551
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6958
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:12.686740 6958 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:12.686975 6958 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:12.692066 6971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:12.692021 6966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:12.692030 6968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:12.692276 6958 server_base.cc:1034] running on GCE node
I20260808 05:07:12.692552 6958 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:12.692829 6958 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:12.693976 6958 hybrid_clock.cc:648] HybridClock initialized: now 1786165632693960 us; error 28 us; skew 500 ppm
Aug 08 05:07:12 dist-test-slave-7kzw krb5kdc[6938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:12.696527 6958 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:12.697046 6958 webserver.cc:460] Webserver started at http://127.11.70.254:42481/ using document root <none> and password file <none>
I20260808 05:07:12.697300 6958 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:12.697371 6958 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:12.697523 6958 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:12.698665 6958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "500c6cf3839244eebdf36092952d061e"
format_stamp: "Formatted at 2026-08-08 05:07:12 on dist-test-slave-7kzw"
server_key: "718d92b1720e2fab47a453a4a2c86c5e"
server_key_iv: "00de943df0f873381821e5a64bc0a351"
server_key_version: "encryptionkey@0"
I20260808 05:07:12.699045 6958 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "500c6cf3839244eebdf36092952d061e"
format_stamp: "Formatted at 2026-08-08 05:07:12 on dist-test-slave-7kzw"
server_key: "718d92b1720e2fab47a453a4a2c86c5e"
server_key_iv: "00de943df0f873381821e5a64bc0a351"
server_key_version: "encryptionkey@0"
I20260808 05:07:12.700445 6958 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:12.701211 6981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:12.701401 6958 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:07:12.701515 6958 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "500c6cf3839244eebdf36092952d061e"
format_stamp: "Formatted at 2026-08-08 05:07:12 on dist-test-slave-7kzw"
server_key: "718d92b1720e2fab47a453a4a2c86c5e"
server_key_iv: "00de943df0f873381821e5a64bc0a351"
server_key_version: "encryptionkey@0"
I20260808 05:07:12.701592 6958 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:12.727144 6958 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:12.729513 6958 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:12.729717 6958 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:12.734241 6958 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:43551
I20260808 05:07:12.734297 7060 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:43551 every 8 connection(s)
I20260808 05:07:12.734727 6958 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:12.735628 7061 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:12.737892 7061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e: Bootstrap starting.
I20260808 05:07:12.738443 7061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:12.738797 7061 log.cc:824] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:12.739486 7061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e: No bootstrap required, opened a new log
I20260808 05:07:12.741030 7061 raft_consensus.cc:348] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500c6cf3839244eebdf36092952d061e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43551 } }
I20260808 05:07:12.741165 7061 raft_consensus.cc:374] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:12.741199 7061 raft_consensus.cc:729] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 500c6cf3839244eebdf36092952d061e, State: Initialized, Role: FOLLOWER
I20260808 05:07:12.741299 7061 consensus_queue.cc:260] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500c6cf3839244eebdf36092952d061e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43551 } }
I20260808 05:07:12.741393 7061 raft_consensus.cc:388] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:12.741442 7061 raft_consensus.cc:482] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:12.741500 7061 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:12.742086 7061 raft_consensus.cc:504] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500c6cf3839244eebdf36092952d061e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43551 } }
I20260808 05:07:12.742223 7061 leader_election.cc:302] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 500c6cf3839244eebdf36092952d061e; no voters:
I20260808 05:07:12.742415 7061 leader_election.cc:288] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:12.742537 7066 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:12.742707 7066 raft_consensus.cc:686] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [term 1 LEADER]: Becoming Leader. State: Replica: 500c6cf3839244eebdf36092952d061e, State: Running, Role: LEADER
I20260808 05:07:12.742766 7061 sys_catalog.cc:564] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:12.742805 7066 consensus_queue.cc:237] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500c6cf3839244eebdf36092952d061e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43551 } }
I20260808 05:07:12.743230 7068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 500c6cf3839244eebdf36092952d061e. Latest consensus state: current_term: 1 leader_uuid: "500c6cf3839244eebdf36092952d061e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500c6cf3839244eebdf36092952d061e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43551 } } }
I20260808 05:07:12.743321 7068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:12.743356 7067 sys_catalog.cc:455] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "500c6cf3839244eebdf36092952d061e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "500c6cf3839244eebdf36092952d061e" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43551 } } }
I20260808 05:07:12.743459 7067 sys_catalog.cc:458] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:12.743737 7075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:12.744237 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 6958
I20260808 05:07:12.744287 7075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:12.744374 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:12.744632 11547 external_mini_cluster.cc:1428] Setting key 5ba7b89b582405816d8e798e88e24674
I20260808 05:07:12.745970 7075 catalog_manager.cc:1347] Generated new cluster ID: f4cef991c62d40dcaed9ca62ee967efb
I20260808 05:07:12.746028 7075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:07:12 dist-test-slave-7kzw krb5kdc[6938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165632, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:12.754922 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:12.745166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41038 (local address 127.11.70.254:43551)
0808 05:07:12.745332 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:12.745342 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:12.745558 (+ 216us) server_negotiation.cc:407] Connection header received
0808 05:07:12.745693 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:12.745700 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:12.745761 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:12.746724 (+ 963us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:12.746803 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:12.747713 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:12.748485 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:12.748924 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:12.749047 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:12.751430 (+ 2383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:12.751434 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:12.751434 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:12.751447 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:12.753190 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:12.753616 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:12.753620 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:12.753620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:12.753730 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:12.753948 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:12.753949 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:12.753949 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:12.754203 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:12.754373 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:12.754530 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 05:07:12.754686 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260808 05:07:12.759269 7075 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:12.759961 7075 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:12.768764 7075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e: Generated new TSK 0
I20260808 05:07:12.768965 7075 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.11.70.193@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.193@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
Entry for principal kudu/127.11.70.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab.
I20260808 05:07:12.801498 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43551
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:33929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:12.888891 7097 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:12.889127 7097 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:12.889171 7097 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:12.890359 7097 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:12.890427 7097 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:12.890470 7097 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:07:12.892031 7097 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:33929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.193.keytab
--principal=kudu/127.11.70.193
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7097
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:12.892318 7097 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:12.892583 7097 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:12.898036 7106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:12.898027 7104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:12.898005 7102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:12.898206 7097 server_base.cc:1034] running on GCE node
I20260808 05:07:12.898501 7097 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:12.898777 7097 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:12.899981 7097 hybrid_clock.cc:648] HybridClock initialized: now 1786165632899966 us; error 65 us; skew 500 ppm
Aug 08 05:07:12 dist-test-slave-7kzw krb5kdc[6938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:12.902954 7097 init.cc:377] Logged in from keytab as kudu/127.11.70.193@KRBTEST.COM (short username kudu)
I20260808 05:07:12.903467 7097 webserver.cc:460] Webserver started at http://127.11.70.193:34167/ using document root <none> and password file <none>
I20260808 05:07:12.903782 7097 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:12.903868 7097 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:12.904036 7097 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:12.905289 7097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "da2a7823b3c346e08886d51cd04cbc73"
format_stamp: "Formatted at 2026-08-08 05:07:12 on dist-test-slave-7kzw"
server_key: "f4105b226833aab0f06891c722f28c35"
server_key_iv: "5f21ca2093d0cef5d9df59c37c43dd54"
server_key_version: "encryptionkey@0"
I20260808 05:07:12.905706 7097 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "da2a7823b3c346e08886d51cd04cbc73"
format_stamp: "Formatted at 2026-08-08 05:07:12 on dist-test-slave-7kzw"
server_key: "f4105b226833aab0f06891c722f28c35"
server_key_iv: "5f21ca2093d0cef5d9df59c37c43dd54"
server_key_version: "encryptionkey@0"
I20260808 05:07:12.907294 7097 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260808 05:07:12.908252 7118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:12.908476 7097 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:12.908631 7097 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "da2a7823b3c346e08886d51cd04cbc73"
format_stamp: "Formatted at 2026-08-08 05:07:12 on dist-test-slave-7kzw"
server_key: "f4105b226833aab0f06891c722f28c35"
server_key_iv: "5f21ca2093d0cef5d9df59c37c43dd54"
server_key_version: "encryptionkey@0"
I20260808 05:07:12.908720 7097 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:12.927323 7097 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:12.929379 7097 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:12.929562 7097 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:12.929817 7097 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:12.930160 7097 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:12.930218 7097 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:12.930261 7097 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:12.930291 7097 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:12.936476 7097 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:33409
I20260808 05:07:12.936566 7281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:33409 every 8 connection(s)
I20260808 05:07:12.936985 7097 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:07:12.938414 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 7097
I20260808 05:07:12.938576 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:07:12.938793 11547 external_mini_cluster.cc:1428] Setting key de3a71084219809ada42bbed08d8a61f
Aug 08 05:07:12 dist-test-slave-7kzw krb5kdc[6938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165632, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.193@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:12.947737 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:12.937819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:43025 (local address 127.11.70.254:43551)
0808 05:07:12.937868 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:12.937870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:12.938067 (+ 197us) server_negotiation.cc:407] Connection header received
0808 05:07:12.938907 (+ 840us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:12.938909 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:12.938926 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:12.939019 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:12.940076 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:12.940587 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:12.941632 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:12.941858 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:12.941937 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:12.944584 (+ 2647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:12.944586 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:12.944587 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:12.944597 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:12.946093 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:12.946595 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:12.946597 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:12.946597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:12.946667 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:12.947006 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:12.947007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:12.947007 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:12.947135 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:12.947210 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:12.947532 (+ 322us) server_negotiation.cc:299] Negotiation successful
0808 05:07:12.947640 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:07:12.947933 7284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:12.937767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:43551 (local address 127.11.70.193:43025)
0808 05:07:12.937932 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:12.937978 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:12.938762 (+ 784us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:12.939109 (+ 347us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:12.939114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:12.939755 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:12.939956 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:12.939961 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:12.940686 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:12.940687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:12.941519 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:12.941521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:12.941946 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:12.941948 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:12.942088 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:12.942680 (+ 592us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:12.942688 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:12.944475 (+ 1787us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:12.946201 (+ 1726us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:12.946210 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:12.946213 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:12.946529 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:12.946780 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:12.946781 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:12.946782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:12.946926 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:12.947212 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:12.947221 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:12.947384 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 05:07:12.947490 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 05:07:12.947665 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":77,"threads_started":1}
I20260808 05:07:12.948448 7282 heartbeater.cc:347] Connected to a master server at 127.11.70.254:43551
I20260808 05:07:12.948552 7282 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:12.948764 7282 heartbeater.cc:511] Master 127.11.70.254:43551 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.11.70.194@KRBTEST.COM; defaulting to no policy
I20260808 05:07:12.949381 7003 ts_manager.cc:194] Registered new tserver with Master: da2a7823b3c346e08886d51cd04cbc73 (127.11.70.193:33409)
I20260808 05:07:12.950050 7003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.193@KRBTEST.COM'} at 127.11.70.193:43025
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.194@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
Entry for principal kudu/127.11.70.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab.
I20260808 05:07:12.970438 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43551
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:33929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:13.058951 7291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:13.059209 7291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:13.059248 7291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:13.060451 7291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:13.060524 7291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:13.060570 7291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:07:13.062048 7291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:33929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.194.keytab
--principal=kudu/127.11.70.194
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:13.062350 7291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:13.062603 7291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:13.067800 7298 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:13.067814 7301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:13.067814 7299 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:13.068245 7291 server_base.cc:1034] running on GCE node
I20260808 05:07:13.068434 7291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:13.068684 7291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:13.069844 7291 hybrid_clock.cc:648] HybridClock initialized: now 1786165633069790 us; error 67 us; skew 500 ppm
Aug 08 05:07:13 dist-test-slave-7kzw krb5kdc[6938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165633, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:13.072764 7291 init.cc:377] Logged in from keytab as kudu/127.11.70.194@KRBTEST.COM (short username kudu)
I20260808 05:07:13.073225 7291 webserver.cc:460] Webserver started at http://127.11.70.194:36095/ using document root <none> and password file <none>
I20260808 05:07:13.073474 7291 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:13.073521 7291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:13.073657 7291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:13.074882 7291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "da83cfdd586546b1b1266172a321de28"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "b135389c0432ccea01ebb2cba8cbba7f"
server_key_iv: "729fee32d5e341661e511b7f7091eac2"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.075253 7291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "da83cfdd586546b1b1266172a321de28"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "b135389c0432ccea01ebb2cba8cbba7f"
server_key_iv: "729fee32d5e341661e511b7f7091eac2"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.076702 7291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 05:07:13.077592 7311 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.077857 7291 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:13.077956 7291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "da83cfdd586546b1b1266172a321de28"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "b135389c0432ccea01ebb2cba8cbba7f"
server_key_iv: "729fee32d5e341661e511b7f7091eac2"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.078030 7291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:13.089427 7291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:13.091789 7291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:13.091981 7291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:13.092254 7291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:13.092672 7291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:13.092720 7291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.092772 7291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:13.092803 7291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.099696 7291 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:39657
I20260808 05:07:13.099763 7475 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:39657 every 8 connection(s)
I20260808 05:07:13.100135 7291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:07:13 dist-test-slave-7kzw krb5kdc[6938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165633, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.194@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:13.107636 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 7291
I20260808 05:07:13.107784 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:07:13.108013 11547 external_mini_cluster.cc:1428] Setting key 9b1f12b62e18e6c02bc198e182e19055
I20260808 05:07:13.111300 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.100951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:46951 (local address 127.11.70.254:43551)
0808 05:07:13.101000 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.101002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.101288 (+ 286us) server_negotiation.cc:407] Connection header received
0808 05:07:13.101897 (+ 609us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.101898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.101913 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.101971 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:13.103202 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.103792 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.104935 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.105239 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.105305 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.107853 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:13.107859 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:13.107860 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:13.107867 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:13.109770 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:13.110189 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:13.110190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:13.110191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:13.110261 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:13.110555 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:13.110556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:13.110556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:13.110713 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:13.110785 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.111093 (+ 308us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.111189 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:07:13.111491 7478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.100946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:43551 (local address 127.11.70.194:46951)
0808 05:07:13.101146 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.101186 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:13.101761 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:13.102055 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:13.102060 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:13.102817 (+ 757us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:13.103050 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.103055 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.103942 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.103943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.104805 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.104807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.105342 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.105343 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.105456 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.106075 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:13.106084 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:13.107724 (+ 1640us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:13.109862 (+ 2138us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:13.109870 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:13.109872 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:13.110111 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:13.110331 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:13.110331 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:13.110331 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:13.110439 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:13.110797 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:13.110804 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:13.110938 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 05:07:13.111053 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 05:07:13.111225 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":101,"threads_started":1}
I20260808 05:07:13.112006 7476 heartbeater.cc:347] Connected to a master server at 127.11.70.254:43551
I20260808 05:07:13.112130 7476 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:13.112339 7476 heartbeater.cc:511] Master 127.11.70.254:43551 requested a full tablet report, sending...
I20260808 05:07:13.112753 7003 ts_manager.cc:194] Registered new tserver with Master: da83cfdd586546b1b1266172a321de28 (127.11.70.194:39657)
I20260808 05:07:13.113138 7003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.194@KRBTEST.COM'} at 127.11.70.194:46951
WARNING: no policy specified for kudu/127.11.70.195@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.195@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
Entry for principal kudu/127.11.70.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab.
I20260808 05:07:13.137857 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43551
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:33929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:13.225441 7483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:13.225672 7483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:13.225698 7483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:13.226922 7483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:13.226970 7483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:13.226998 7483 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:07:13.228538 7483 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:33929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.195.keytab
--principal=kudu/127.11.70.195
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:43551
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:13.228807 7483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:13.229065 7483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:13.234465 7492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:13.234438 7493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:13.234426 7498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:13.234815 7483 server_base.cc:1034] running on GCE node
I20260808 05:07:13.235049 7483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:13.235327 7483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:13.236506 7483 hybrid_clock.cc:648] HybridClock initialized: now 1786165633236493 us; error 30 us; skew 500 ppm
Aug 08 05:07:13 dist-test-slave-7kzw krb5kdc[6938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165633, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:13.239107 7483 init.cc:377] Logged in from keytab as kudu/127.11.70.195@KRBTEST.COM (short username kudu)
I20260808 05:07:13.239634 7483 webserver.cc:460] Webserver started at http://127.11.70.195:39479/ using document root <none> and password file <none>
I20260808 05:07:13.239898 7483 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:13.239971 7483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:13.240126 7483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:13.241191 7483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "a241405b5836465c9cdf6d25eb849e6c"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "1c70e22f7c780063ec5a76f9a16760fd"
server_key_iv: "7294fa42aeb40c8b1049dd80308b99bd"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.241580 7483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "a241405b5836465c9cdf6d25eb849e6c"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "1c70e22f7c780063ec5a76f9a16760fd"
server_key_iv: "7294fa42aeb40c8b1049dd80308b99bd"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.243206 7483 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:13.244131 7506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.244385 7483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:13.244516 7483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "a241405b5836465c9cdf6d25eb849e6c"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "1c70e22f7c780063ec5a76f9a16760fd"
server_key_iv: "7294fa42aeb40c8b1049dd80308b99bd"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.244614 7483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:13.259140 7483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:13.261459 7483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:13.261634 7483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:13.261886 7483 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:13.262223 7483 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:13.262282 7483 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.262324 7483 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:13.262353 7483 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.269030 7483 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:40037
I20260808 05:07:13.269093 7662 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:40037 every 8 connection(s)
I20260808 05:07:13.269480 7483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:07:13.274130 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 7483
I20260808 05:07:13.274246 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:07:13.274420 11547 external_mini_cluster.cc:1428] Setting key 365ac80556522a49c6705cd38b4d4ad7
Aug 08 05:07:13 dist-test-slave-7kzw krb5kdc[6938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165633, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.195@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:13.279927 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.270266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:40589 (local address 127.11.70.254:43551)
0808 05:07:13.270350 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.270353 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.270538 (+ 185us) server_negotiation.cc:407] Connection header received
0808 05:07:13.271065 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.271066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.271079 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.271147 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:13.272091 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.272589 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.273596 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.273785 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.273843 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.276612 (+ 2769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:13.276614 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:13.276614 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:13.276621 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:13.278146 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:13.278705 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:13.278706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:13.278707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:13.278777 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:13.279196 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:13.279197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:13.279197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:13.279356 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:13.279422 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.279777 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.279857 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:07:13.280079 7665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.270209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:43551 (local address 127.11.70.195:40589)
0808 05:07:13.270384 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.270422 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:13.270952 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:13.271200 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:13.271204 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:13.271779 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:13.271975 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.271979 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.272691 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.272692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.273517 (+ 825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.273519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.273863 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.273863 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.274035 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.274717 (+ 682us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:13.274726 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:13.276509 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:13.278248 (+ 1739us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:13.278256 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:13.278258 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:13.278605 (+ 347us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:13.278881 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:13.278882 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:13.278882 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:13.279058 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:13.279437 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:13.279444 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:13.279588 (+ 144us) client_negotiation.cc:769] Sending connection context
0808 05:07:13.279694 (+ 106us) client_negotiation.cc:240] Negotiation successful
0808 05:07:13.279841 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":111,"threads_started":1}
I20260808 05:07:13.280737 7663 heartbeater.cc:347] Connected to a master server at 127.11.70.254:43551
I20260808 05:07:13.280915 7663 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:13.281121 7663 heartbeater.cc:511] Master 127.11.70.254:43551 requested a full tablet report, sending...
I20260808 05:07:13.281551 7003 ts_manager.cc:194] Registered new tserver with Master: a241405b5836465c9cdf6d25eb849e6c (127.11.70.195:40037)
I20260808 05:07:13.282001 7003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.70.195@KRBTEST.COM'} at 127.11.70.195:40589
I20260808 05:07:13.286870 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:07:13.295094 7092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.288227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41048 (local address 127.11.70.254:43551)
0808 05:07:13.288276 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.288278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.288427 (+ 149us) server_negotiation.cc:407] Connection header received
0808 05:07:13.288457 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.288457 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.288468 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.288519 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:13.289254 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.289790 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.290571 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.290786 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.290848 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.292043 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:13.292044 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:13.292044 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:13.292051 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:13.293784 (+ 1733us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:13.294116 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:13.294117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:13.294117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:13.294175 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:13.294408 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:13.294410 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:13.294410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:13.294738 (+ 328us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:13.294829 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.294946 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.295025 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:07:13.296768 7003 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41048:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:07:13.298451 7003 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:07:13.305747 7678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.301113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:40037 (local address 127.0.0.1:35388)
0808 05:07:13.301467 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.301475 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:13.301517 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:13.301943 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:13.301944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:13.301946 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:13.302031 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.302034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.303082 (+ 1048us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.303083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.304325 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.304328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.305411 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.305413 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.305498 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.305510 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 05:07:13.305582 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 05:07:13.305634 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":86,"threads_started":1}
I20260808 05:07:13.305771 7682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.301374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35388 (local address 127.11.70.195:40037)
0808 05:07:13.301540 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.301545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.301561 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:07:13.301606 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.301608 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.301673 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.301776 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:13.302138 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.302965 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.304425 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.305242 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.305315 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.305375 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.305627 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.305679 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260808 05:07:13.306774 7680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.301269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44686 (local address 127.11.70.194:39657)
0808 05:07:13.301692 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.301697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.301708 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:07:13.301747 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.301749 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.301764 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.301877 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:13.302140 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.303341 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.304632 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.305822 (+ 1190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.306530 (+ 708us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.306600 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.306628 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.306676 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":112,"threads_started":1}
I20260808 05:07:13.306721 7575 tablet_service.cc:1467] Processing CreateTablet for tablet 2031df4e966b4e5980e2907ecae7b038 (DEFAULT_TABLE table=test-table [id=1af8d7b9459e4424b0b012d0ba763700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:13.306943 7683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.301641 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39442 (local address 127.11.70.193:33409)
0808 05:07:13.301874 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.301879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.301889 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:07:13.301930 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.301932 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.301947 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.302022 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:13.302233 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.303348 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.305770 (+ 2422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.306569 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.306662 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.306723 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.306810 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.306852 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":111,"threads_started":1}
I20260808 05:07:13.307147 7681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.301341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:33409 (local address 127.0.0.1:39442)
0808 05:07:13.301516 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.301525 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:13.301561 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:13.302102 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:13.302103 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:13.302105 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:13.302141 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.302142 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.304617 (+ 2475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.304618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.305665 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.305668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.306666 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.306667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.306730 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.306734 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:07:13.306795 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 05:07:13.306838 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":78,"threads_started":1}
I20260808 05:07:13.307170 7575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2031df4e966b4e5980e2907ecae7b038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:13.307904 7179 tablet_service.cc:1467] Processing CreateTablet for tablet 2031df4e966b4e5980e2907ecae7b038 (DEFAULT_TABLE table=test-table [id=1af8d7b9459e4424b0b012d0ba763700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:13.308283 7179 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2031df4e966b4e5980e2907ecae7b038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:13.310644 7679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.301111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:39657 (local address 127.0.0.1:44686)
0808 05:07:13.301303 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.301348 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:13.301413 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:13.301891 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:13.301894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:13.301897 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:13.302048 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.302051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.303463 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.303465 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.304522 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.304525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.305937 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.305938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.306015 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.306020 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:07:13.306184 (+ 164us) client_negotiation.cc:240] Negotiation successful
0808 05:07:13.310591 (+ 4407us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":76,"threads_started":1}
I20260808 05:07:13.311012 7686 tablet_bootstrap.cc:492] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: Bootstrap starting.
I20260808 05:07:13.311514 7381 tablet_service.cc:1467] Processing CreateTablet for tablet 2031df4e966b4e5980e2907ecae7b038 (DEFAULT_TABLE table=test-table [id=1af8d7b9459e4424b0b012d0ba763700]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:13.311862 7686 tablet_bootstrap.cc:654] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:13.311885 7381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2031df4e966b4e5980e2907ecae7b038. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:13.312199 7688 tablet_bootstrap.cc:492] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73: Bootstrap starting.
I20260808 05:07:13.312533 7686 log.cc:824] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:13.312986 7688 tablet_bootstrap.cc:654] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:13.313421 7686 tablet_bootstrap.cc:492] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: No bootstrap required, opened a new log
I20260808 05:07:13.313501 7686 ts_tablet_manager.cc:1397] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:07:13.313570 7688 log.cc:824] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:13.314303 7688 tablet_bootstrap.cc:492] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73: No bootstrap required, opened a new log
I20260808 05:07:13.314389 7688 ts_tablet_manager.cc:1397] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:13.315394 7695 tablet_bootstrap.cc:492] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28: Bootstrap starting.
I20260808 05:07:13.315790 7686 raft_consensus.cc:348] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } }
I20260808 05:07:13.315968 7686 raft_consensus.cc:374] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:13.316015 7686 raft_consensus.cc:729] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a241405b5836465c9cdf6d25eb849e6c, State: Initialized, Role: FOLLOWER
I20260808 05:07:13.316105 7695 tablet_bootstrap.cc:654] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:13.316155 7686 consensus_queue.cc:260] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } }
I20260808 05:07:13.316507 7663 heartbeater.cc:503] Master 127.11.70.254:43551 was elected leader, sending a full tablet report...
I20260808 05:07:13.316495 7686 ts_tablet_manager.cc:1428] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:13.316598 7688 raft_consensus.cc:348] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } }
I20260808 05:07:13.316757 7695 log.cc:824] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:13.316800 7688 raft_consensus.cc:374] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:13.316840 7688 raft_consensus.cc:729] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da2a7823b3c346e08886d51cd04cbc73, State: Initialized, Role: FOLLOWER
I20260808 05:07:13.316978 7688 consensus_queue.cc:260] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } }
I20260808 05:07:13.317328 7688 ts_tablet_manager.cc:1428] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:13.317334 7282 heartbeater.cc:503] Master 127.11.70.254:43551 was elected leader, sending a full tablet report...
I20260808 05:07:13.318015 7695 tablet_bootstrap.cc:492] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28: No bootstrap required, opened a new log
I20260808 05:07:13.318089 7695 ts_tablet_manager.cc:1397] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:07:13.319815 7695 raft_consensus.cc:348] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } }
I20260808 05:07:13.319988 7695 raft_consensus.cc:374] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:13.320036 7695 raft_consensus.cc:729] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da83cfdd586546b1b1266172a321de28, State: Initialized, Role: FOLLOWER
I20260808 05:07:13.320159 7695 consensus_queue.cc:260] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } }
I20260808 05:07:13.320446 7695 ts_tablet_manager.cc:1428] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:07:13.320523 7476 heartbeater.cc:503] Master 127.11.70.254:43551 was elected leader, sending a full tablet report...
I20260808 05:07:13.338266 7696 raft_consensus.cc:482] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:07:13.338409 7696 raft_consensus.cc:504] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } }
I20260808 05:07:13.339102 7696 leader_election.cc:288] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers da83cfdd586546b1b1266172a321de28 (127.11.70.194:39657), da2a7823b3c346e08886d51cd04cbc73 (127.11.70.193:33409)
I20260808 05:07:13.342985 7680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.339373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:58029 (local address 127.11.70.194:39657)
0808 05:07:13.339419 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.339421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.339430 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:13.339458 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.339459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.339471 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.339536 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:13.339729 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.340473 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.341942 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.342592 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.342719 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.342728 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.342869 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.342911 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:07:13.342984 7683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.339366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:39913 (local address 127.11.70.193:33409)
0808 05:07:13.339412 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.339414 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.339606 (+ 192us) server_negotiation.cc:407] Connection header received
0808 05:07:13.339649 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.339651 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.339663 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.339739 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:13.339865 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.340575 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.341941 (+ 1366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.342572 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.342653 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.342664 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.342869 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.342911 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:07:13.342998 7665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.339264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:39657 (local address 127.11.70.195:58029)
0808 05:07:13.339311 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.339326 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:13.339381 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:13.339549 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:13.339550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:13.339552 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:13.339638 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.339640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.340560 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.340562 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.341838 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.341841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.342718 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.342718 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.342792 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.342795 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:13.342850 (+ 55us) client_negotiation.cc:240] Negotiation successful
0808 05:07:13.342889 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":32}
I20260808 05:07:13.343326 7701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.339264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:33409 (local address 127.11.70.195:39913)
0808 05:07:13.339496 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.339533 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:13.339589 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:13.339751 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:13.339752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:13.339753 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:13.339807 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.339808 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.340656 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.340657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.341838 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.341841 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.342674 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.342676 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.342765 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.342771 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:07:13.342842 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 05:07:13.342889 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":212,"mutex_wait_us":63,"thread_start_us":123,"threads_started":1}
I20260808 05:07:13.343477 7410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2031df4e966b4e5980e2907ecae7b038" candidate_uuid: "a241405b5836465c9cdf6d25eb849e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da83cfdd586546b1b1266172a321de28" is_pre_election: true
I20260808 05:07:13.343667 7410 raft_consensus.cc:2454] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a241405b5836465c9cdf6d25eb849e6c in term 0.
I20260808 05:07:13.343672 7216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2031df4e966b4e5980e2907ecae7b038" candidate_uuid: "a241405b5836465c9cdf6d25eb849e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da2a7823b3c346e08886d51cd04cbc73" is_pre_election: true
I20260808 05:07:13.343844 7216 raft_consensus.cc:2454] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a241405b5836465c9cdf6d25eb849e6c in term 0.
I20260808 05:07:13.343942 7510 leader_election.cc:302] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a241405b5836465c9cdf6d25eb849e6c, da83cfdd586546b1b1266172a321de28; no voters:
I20260808 05:07:13.344143 7696 raft_consensus.cc:2781] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:07:13.344195 7696 raft_consensus.cc:482] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:07:13.344211 7696 raft_consensus.cc:3037] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:13.345074 7696 raft_consensus.cc:504] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } }
I20260808 05:07:13.345232 7696 leader_election.cc:288] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [CANDIDATE]: Term 1 election: Requested vote from peers da83cfdd586546b1b1266172a321de28 (127.11.70.194:39657), da2a7823b3c346e08886d51cd04cbc73 (127.11.70.193:33409)
I20260808 05:07:13.345417 7216 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2031df4e966b4e5980e2907ecae7b038" candidate_uuid: "a241405b5836465c9cdf6d25eb849e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da2a7823b3c346e08886d51cd04cbc73"
I20260808 05:07:13.345417 7410 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2031df4e966b4e5980e2907ecae7b038" candidate_uuid: "a241405b5836465c9cdf6d25eb849e6c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da83cfdd586546b1b1266172a321de28"
I20260808 05:07:13.345499 7216 raft_consensus.cc:3037] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:13.345499 7410 raft_consensus.cc:3037] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:13.346508 7410 raft_consensus.cc:2454] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a241405b5836465c9cdf6d25eb849e6c in term 1.
I20260808 05:07:13.346504 7216 raft_consensus.cc:2454] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a241405b5836465c9cdf6d25eb849e6c in term 1.
I20260808 05:07:13.346722 7509 leader_election.cc:302] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a241405b5836465c9cdf6d25eb849e6c, da2a7823b3c346e08886d51cd04cbc73; no voters:
I20260808 05:07:13.346840 7696 raft_consensus.cc:2781] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:13.347043 7696 raft_consensus.cc:686] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 1 LEADER]: Becoming Leader. State: Replica: a241405b5836465c9cdf6d25eb849e6c, State: Running, Role: LEADER
I20260808 05:07:13.347170 7696 consensus_queue.cc:237] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } }
I20260808 05:07:13.348133 7002 catalog_manager.cc:5495] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c reported cstate change: term changed from 0 to 1, leader changed from <none> to a241405b5836465c9cdf6d25eb849e6c (127.11.70.195). New cstate: current_term: 1 leader_uuid: "a241405b5836465c9cdf6d25eb849e6c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a241405b5836465c9cdf6d25eb849e6c" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 40037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 } health_report { overall_health: UNKNOWN } } }
W20260808 05:07:13.350731 7477 tablet.cc:2369] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:07:13.365674 7682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.363130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33590 (local address 127.11.70.195:40037)
0808 05:07:13.363192 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.363194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.363203 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:13.363270 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.363271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.363292 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.363384 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:13.363555 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.364021 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.364818 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.365042 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.365122 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.365292 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:13.365401 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:13.365491 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.365534 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.365556 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:07:13.367661 7410 raft_consensus.cc:1261] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [term 1 FOLLOWER]: Refusing update from remote peer a241405b5836465c9cdf6d25eb849e6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:13.367673 7216 raft_consensus.cc:1261] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73 [term 1 FOLLOWER]: Refusing update from remote peer a241405b5836465c9cdf6d25eb849e6c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:13.368095 7696 consensus_queue.cc:1035] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "da2a7823b3c346e08886d51cd04cbc73" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 33409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:13.368261 7702 consensus_queue.cc:1035] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [LEADER]: Connected to new peer: Peer: permanent_uuid: "da83cfdd586546b1b1266172a321de28" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 39657 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:13.370888 7705 mvcc.cc:205] Tried to move back new op lower bound from 7316134434270855168 to 7316134434190938112. Current Snapshot: MvccSnapshot[applied={T|T < 7316134434270855168}]
I20260808 05:07:13.370978 7710 mvcc.cc:205] Tried to move back new op lower bound from 7316134434270855168 to 7316134434190938112. Current Snapshot: MvccSnapshot[applied={T|T < 7316134434270855168}]
I20260808 05:07:13.373893 7003 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:13.374017 7003 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41048:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:13.374862 7003 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 500c6cf3839244eebdf36092952d061e: Sending DeleteTablet for 3 replicas of tablet 2031df4e966b4e5980e2907ecae7b038
I20260808 05:07:13.375346 7179 tablet_service.cc:1514] Processing DeleteTablet for tablet 2031df4e966b4e5980e2907ecae7b038 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:13 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:39442
I20260808 05:07:13.375340 7381 tablet_service.cc:1514] Processing DeleteTablet for tablet 2031df4e966b4e5980e2907ecae7b038 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:13 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:44686
I20260808 05:07:13.375340 7575 tablet_service.cc:1514] Processing DeleteTablet for tablet 2031df4e966b4e5980e2907ecae7b038 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:13 UTC) from {username='kudu', principal='kudu/127.11.70.254@KRBTEST.COM'} at 127.0.0.1:35388
I20260808 05:07:13.375670 7722 tablet_replica.cc:330] T 2031df4e966b4e5980e2907ecae7b038 P da2a7823b3c346e08886d51cd04cbc73: stopping tablet replica
I20260808 05:07:13.375734 7724 tablet_replica.cc:330] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: stopping tablet replica
I20260808 05:07:13.375859 7724 raft_consensus.cc:2229] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:07:13.375870 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 7097
I20260808 05:07:13.378371 7724 raft_consensus.cc:2258] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:13.388337 7724 ts_tablet_manager.cc:1905] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:13.390765 7724 ts_tablet_manager.cc:1918] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:13.390875 7724 log.cc:1196] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/2031df4e966b4e5980e2907ecae7b038
I20260808 05:07:13.391199 7724 ts_tablet_manager.cc:1939] T 2031df4e966b4e5980e2907ecae7b038 P a241405b5836465c9cdf6d25eb849e6c: Deleting consensus metadata
I20260808 05:07:13.391860 6985 catalog_manager.cc:4841] TS a241405b5836465c9cdf6d25eb849e6c (127.11.70.195:40037): tablet 2031df4e966b4e5980e2907ecae7b038 (table test-table [id=1af8d7b9459e4424b0b012d0ba763700]) successfully deleted
W20260808 05:07:13.393970 6985 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:33409 (error 108)
I20260808 05:07:13.394611 7723 tablet_replica.cc:330] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28: stopping tablet replica
I20260808 05:07:13.394661 7679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.394512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:33409 (local address 127.0.0.1:37180)
0808 05:07:13.394566 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.394621 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:33409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 05:07:13.394711 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 7291
I20260808 05:07:13.394793 7723 raft_consensus.cc:2229] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:07:13.394932 7723 raft_consensus.cc:2258] T 2031df4e966b4e5980e2907ecae7b038 P da83cfdd586546b1b1266172a321de28 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260808 05:07:13.400770 6985 catalog_manager.cc:4584] TS da2a7823b3c346e08886d51cd04cbc73 (127.11.70.193:33409): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2031df4e966b4e5980e2907ecae7b038: Network error: Client connection negotiation failed: client connection to 127.11.70.193:33409: connect: Connection refused (error 111)
I20260808 05:07:13.405704 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 7483
I20260808 05:07:13.405737 7679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.405603 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:39657 (local address 127.0.0.1:39120)
0808 05:07:13.405658 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.405696 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.194:39657: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:07:13.416376 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 6958
2026-08-08T05:07:13Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2212 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T05:07:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:13Z Disabled control of system clock
I20260808 05:07:13.451848 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:35729
--webserver_interface=127.11.70.254
--webserver_port=0
--builtin_ntp_servers=127.11.70.212:45371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:35729
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:07:13.536010 7732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:13.536291 7732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:13.536314 7732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:13.537526 7732 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:13.537576 7732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:13.537595 7732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:13.537608 7732 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:13.537621 7732 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:13.539095 7732 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:35729
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:35729
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:13.539393 7732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:13.539742 7732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:13.545243 7739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:13.545255 7741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:13.545255 7738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:13.545712 7732 server_base.cc:1034] running on GCE node
I20260808 05:07:13.546027 7732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:13.546373 7732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:13.547567 7732 hybrid_clock.cc:648] HybridClock initialized: now 1786165633547543 us; error 47 us; skew 500 ppm
I20260808 05:07:13.548998 7732 webserver.cc:460] Webserver started at http://127.11.70.254:38003/ using document root <none> and password file <none>
I20260808 05:07:13.549280 7732 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:13.549352 7732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:13.549515 7732 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:13.550705 7732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "72011d376cd34a60bb2b42c54ec46c9d"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "6ba7fc33f4a50ca5ee463151c6d42edf"
server_key_iv: "291b040e6c8994619e44449d7bd7d737"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.551085 7732 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "72011d376cd34a60bb2b42c54ec46c9d"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "6ba7fc33f4a50ca5ee463151c6d42edf"
server_key_iv: "291b040e6c8994619e44449d7bd7d737"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.552453 7732 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:07:13.553421 7750 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.553659 7732 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:13.553781 7732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "72011d376cd34a60bb2b42c54ec46c9d"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "6ba7fc33f4a50ca5ee463151c6d42edf"
server_key_iv: "291b040e6c8994619e44449d7bd7d737"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.553861 7732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:13.565505 7732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:13.565855 7732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:13.566018 7732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:13.570598 7732 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:35729
I20260808 05:07:13.570667 7820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:35729 every 8 connection(s)
I20260808 05:07:13.571041 7732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:13.572165 7821 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:13.574795 7821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d: Bootstrap starting.
I20260808 05:07:13.575403 7821 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:13.575702 7821 log.cc:824] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:13.576469 7821 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d: No bootstrap required, opened a new log
I20260808 05:07:13.576924 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 7732
I20260808 05:07:13.577056 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:13.577286 11547 external_mini_cluster.cc:1428] Setting key 418dd619de8f268fc46c1b7becfe04f5
I20260808 05:07:13.578809 7821 raft_consensus.cc:348] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72011d376cd34a60bb2b42c54ec46c9d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35729 } }
I20260808 05:07:13.579007 7821 raft_consensus.cc:374] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:13.579051 7821 raft_consensus.cc:729] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72011d376cd34a60bb2b42c54ec46c9d, State: Initialized, Role: FOLLOWER
I20260808 05:07:13.579250 7821 consensus_queue.cc:260] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72011d376cd34a60bb2b42c54ec46c9d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35729 } }
I20260808 05:07:13.579344 7821 raft_consensus.cc:388] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:13.579370 7821 raft_consensus.cc:482] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:13.579448 7821 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:13.580041 7821 raft_consensus.cc:504] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72011d376cd34a60bb2b42c54ec46c9d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35729 } }
I20260808 05:07:13.580190 7821 leader_election.cc:302] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 72011d376cd34a60bb2b42c54ec46c9d; no voters:
I20260808 05:07:13.580416 7821 leader_election.cc:288] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:13.580453 7831 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:13.580574 7831 raft_consensus.cc:686] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [term 1 LEADER]: Becoming Leader. State: Replica: 72011d376cd34a60bb2b42c54ec46c9d, State: Running, Role: LEADER
I20260808 05:07:13.580679 7831 consensus_queue.cc:237] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72011d376cd34a60bb2b42c54ec46c9d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35729 } }
I20260808 05:07:13.580725 7821 sys_catalog.cc:564] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:13.581250 7833 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 72011d376cd34a60bb2b42c54ec46c9d. Latest consensus state: current_term: 1 leader_uuid: "72011d376cd34a60bb2b42c54ec46c9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72011d376cd34a60bb2b42c54ec46c9d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35729 } } }
I20260808 05:07:13.581254 7832 sys_catalog.cc:455] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "72011d376cd34a60bb2b42c54ec46c9d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "72011d376cd34a60bb2b42c54ec46c9d" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 35729 } } }
I20260808 05:07:13.581384 7833 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:13.581389 7832 sys_catalog.cc:458] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:13.581703 7840 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:13.582343 7840 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:13.584980 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.577906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45090 (local address 127.11.70.254:35729)
0808 05:07:13.578170 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.578180 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.578221 (+ 41us) server_negotiation.cc:407] Connection header received
0808 05:07:13.578757 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.578768 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.578861 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.579042 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:13.579484 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.581172 (+ 1688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.582277 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.583005 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.583503 (+ 498us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.583992 (+ 489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:13.583996 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:13.583996 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:13.584211 (+ 215us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:13.584257 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:13.584273 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:13.584349 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.584631 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.584735 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":99,"threads_started":1}
I20260808 05:07:13.585072 7840 catalog_manager.cc:1347] Generated new cluster ID: eb3c43782b214e0f81927819d09f3a50
I20260808 05:07:13.585116 7840 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:13.602609 7840 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:13.603295 7840 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:13.611456 7840 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d: Generated new TSK 0
I20260808 05:07:13.611712 7840 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:13.615172 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.193:0
--local_ip_for_outbound_sockets=127.11.70.193
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35729
--builtin_ntp_servers=127.11.70.212:45371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:07:13.704406 7857 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:13.704622 7857 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:13.704644 7857 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:13.705796 7857 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:13.705839 7857 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:13.705864 7857 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.193
I20260808 05:07:13.707325 7857 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.193:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.11.70.193
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7857
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.193
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:13.707594 7857 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:13.707916 7857 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:13.714092 7870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:13.714078 7867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:13.714200 7857 server_base.cc:1034] running on GCE node
W20260808 05:07:13.714078 7864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:13.714578 7857 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:13.714861 7857 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:13.716035 7857 hybrid_clock.cc:648] HybridClock initialized: now 1786165633716022 us; error 46 us; skew 500 ppm
I20260808 05:07:13.717360 7857 webserver.cc:460] Webserver started at http://127.11.70.193:32865/ using document root <none> and password file <none>
I20260808 05:07:13.717615 7857 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:13.717722 7857 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:13.717880 7857 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:13.719028 7857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/data/instance:
uuid: "31c9f9ff061241d59e739da1a9fd9fdf"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "3261d7fbd8bea8628b22fa3b496fa17c"
server_key_iv: "ef05390c79aa310532065fe2900e847a"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.719426 7857 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance:
uuid: "31c9f9ff061241d59e739da1a9fd9fdf"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "3261d7fbd8bea8628b22fa3b496fa17c"
server_key_iv: "ef05390c79aa310532065fe2900e847a"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.720764 7857 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:07:13.721521 7881 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.721697 7857 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:07:13.721809 7857 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/wal
uuid: "31c9f9ff061241d59e739da1a9fd9fdf"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "3261d7fbd8bea8628b22fa3b496fa17c"
server_key_iv: "ef05390c79aa310532065fe2900e847a"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.721886 7857 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:13.737536 7857 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:13.737872 7857 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:13.738037 7857 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:13.738296 7857 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:13.738700 7857 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:13.738760 7857 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.738798 7857 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:13.738847 7857 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.745079 7857 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.193:40663
I20260808 05:07:13.745178 8036 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.193:40663 every 8 connection(s)
I20260808 05:07:13.745503 7857 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/data/info.pb
I20260808 05:07:13.750735 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.746300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.193:34783 (local address 127.11.70.254:35729)
0808 05:07:13.746375 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.746378 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.746699 (+ 321us) server_negotiation.cc:407] Connection header received
0808 05:07:13.747207 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.747208 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.747221 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.747287 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:13.747936 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.748428 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.749402 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.749585 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.749637 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.750441 (+ 804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:13.750442 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:13.750442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:13.750448 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:13.750461 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:13.750505 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:13.750560 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.750651 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.750674 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:07:13.750959 8039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.746293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:35729 (local address 127.11.70.193:34783)
0808 05:07:13.746567 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.746602 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:13.747113 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:13.747342 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:13.747346 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:13.747354 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:13.747864 (+ 510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.747869 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.748515 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.748516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.749324 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.749327 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.749664 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.749665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.749800 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.750309 (+ 509us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:07:13.750310 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:13.750339 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:07:13.750361 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:13.750576 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:13.750582 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:13.750584 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:07:13.750640 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 05:07:13.750719 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":114,"threads_started":1}
I20260808 05:07:13.751472 8037 heartbeater.cc:347] Connected to a master server at 127.11.70.254:35729
I20260808 05:07:13.751578 8037 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:13.751706 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 7857
I20260808 05:07:13.751824 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-0/wal/instance
I20260808 05:07:13.751818 8037 heartbeater.cc:511] Master 127.11.70.254:35729 requested a full tablet report, sending...
I20260808 05:07:13.752070 11547 external_mini_cluster.cc:1428] Setting key 184bfdd1f2948248a108d01163458b56
I20260808 05:07:13.752399 7772 ts_manager.cc:194] Registered new tserver with Master: 31c9f9ff061241d59e739da1a9fd9fdf (127.11.70.193:40663)
I20260808 05:07:13.753141 7772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.193:34783
I20260808 05:07:13.753233 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.194:0
--local_ip_for_outbound_sockets=127.11.70.194
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35729
--builtin_ntp_servers=127.11.70.212:45371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:07:13.838400 8040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:13.838712 8040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:13.838737 8040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:13.839956 8040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:13.840003 8040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:13.840029 8040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.194
I20260808 05:07:13.841331 8040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.194:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.11.70.194
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.194
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:13.841538 8040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:13.841811 8040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:13.847472 8051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:13.847451 8057 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:13.847452 8054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:13.847883 8040 server_base.cc:1034] running on GCE node
I20260808 05:07:13.848151 8040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:13.848409 8040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:13.849596 8040 hybrid_clock.cc:648] HybridClock initialized: now 1786165633849571 us; error 38 us; skew 500 ppm
I20260808 05:07:13.851073 8040 webserver.cc:460] Webserver started at http://127.11.70.194:35447/ using document root <none> and password file <none>
I20260808 05:07:13.851353 8040 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:13.851429 8040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:13.851594 8040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:13.852731 8040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/data/instance:
uuid: "3cbac1f54df24eb8bdc21d1ad93d2795"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "b9c4481fd38b49ac6186ddc288f7e3f5"
server_key_iv: "18afd7476a7300dbbebf542243d14d3d"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.853111 8040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance:
uuid: "3cbac1f54df24eb8bdc21d1ad93d2795"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "b9c4481fd38b49ac6186ddc288f7e3f5"
server_key_iv: "18afd7476a7300dbbebf542243d14d3d"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.854547 8040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:13.855489 8063 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.855749 8040 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:13.855865 8040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/wal
uuid: "3cbac1f54df24eb8bdc21d1ad93d2795"
format_stamp: "Formatted at 2026-08-08 05:07:13 on dist-test-slave-7kzw"
server_key: "b9c4481fd38b49ac6186ddc288f7e3f5"
server_key_iv: "18afd7476a7300dbbebf542243d14d3d"
server_key_version: "encryptionkey@0"
I20260808 05:07:13.855953 8040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:13.911885 8040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:13.912274 8040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:13.912444 8040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:13.912719 8040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:13.913080 8040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:13.913139 8040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.913187 8040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:13.913213 8040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:13.919540 8040 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.194:38895
I20260808 05:07:13.919589 8220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.194:38895 every 8 connection(s)
I20260808 05:07:13.920004 8040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/data/info.pb
I20260808 05:07:13.925964 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.920808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.194:56229 (local address 127.11.70.254:35729)
0808 05:07:13.920852 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:13.920855 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:13.921151 (+ 296us) server_negotiation.cc:407] Connection header received
0808 05:07:13.921692 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:13.921694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:13.921706 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:13.921776 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:13.922611 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.923133 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.924238 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.924445 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.924513 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.925512 (+ 999us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:13.925513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:13.925513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:13.925518 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:13.925535 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:13.925538 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:13.925587 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:13.925666 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 05:07:13.925883 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:07:13.926044 8223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:13.920764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:35729 (local address 127.11.70.194:56229)
0808 05:07:13.920977 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:13.921022 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:13.921566 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:13.921869 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:13.921873 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:13.921881 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:13.922421 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.922426 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.923246 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.923247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.924139 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:13.924142 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:13.924563 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:13.924565 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:13.924784 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:13.925364 (+ 580us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:07:13.925364 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:13.925397 (+ 33us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:07:13.925422 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:13.925600 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:13.925605 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:13.925607 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:07:13.925660 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 05:07:13.925834 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":109,"threads_started":1}
I20260808 05:07:13.926786 8221 heartbeater.cc:347] Connected to a master server at 127.11.70.254:35729
I20260808 05:07:13.926913 8221 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:13.927125 8221 heartbeater.cc:511] Master 127.11.70.254:35729 requested a full tablet report, sending...
I20260808 05:07:13.927598 7772 ts_manager.cc:194] Registered new tserver with Master: 3cbac1f54df24eb8bdc21d1ad93d2795 (127.11.70.194:38895)
I20260808 05:07:13.927994 7772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.194:56229
I20260808 05:07:13.930174 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 8040
I20260808 05:07:13.930279 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/wal/instance
I20260808 05:07:13.930546 11547 external_mini_cluster.cc:1428] Setting key 93ee6235f9a163864bacf7e8a2ddc9df
I20260808 05:07:13.931519 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.11.70.195:0
--local_ip_for_outbound_sockets=127.11.70.195
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35729
--builtin_ntp_servers=127.11.70.212:45371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:07:14.027022 8224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:14.027298 8224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:14.027343 8224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:14.028568 8224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:14.028609 8224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:14.028635 8224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.70.195
I20260808 05:07:14.029947 8224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:45371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.11.70.195:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.11.70.195
--webserver_port=0
--tserver_master_addrs=127.11.70.254:35729
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.11.70.195
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:14.030146 8224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:14.030413 8224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:14.035876 8236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:14.036137 8233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:14.036150 8231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:14.036461 8224 server_base.cc:1034] running on GCE node
I20260808 05:07:14.036770 8224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:14.037036 8224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:14.038216 8224 hybrid_clock.cc:648] HybridClock initialized: now 1786165634038199 us; error 45 us; skew 500 ppm
I20260808 05:07:14.039842 8224 webserver.cc:460] Webserver started at http://127.11.70.195:43201/ using document root <none> and password file <none>
I20260808 05:07:14.040122 8224 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:14.040175 8224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:14.040282 8224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:14.041396 8224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/data/instance:
uuid: "fbfbfb29aba740068706c2b4c4682c17"
format_stamp: "Formatted at 2026-08-08 05:07:14 on dist-test-slave-7kzw"
server_key: "2d5b096f0f203885956aeba225525739"
server_key_iv: "cbbf8f565108df9b813ee4eb236d5537"
server_key_version: "encryptionkey@0"
I20260808 05:07:14.041719 8224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance:
uuid: "fbfbfb29aba740068706c2b4c4682c17"
format_stamp: "Formatted at 2026-08-08 05:07:14 on dist-test-slave-7kzw"
server_key: "2d5b096f0f203885956aeba225525739"
server_key_iv: "cbbf8f565108df9b813ee4eb236d5537"
server_key_version: "encryptionkey@0"
I20260808 05:07:14.043269 8224 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:14.044116 8244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:14.044318 8224 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:14.044423 8224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/wal
uuid: "fbfbfb29aba740068706c2b4c4682c17"
format_stamp: "Formatted at 2026-08-08 05:07:14 on dist-test-slave-7kzw"
server_key: "2d5b096f0f203885956aeba225525739"
server_key_iv: "cbbf8f565108df9b813ee4eb236d5537"
server_key_version: "encryptionkey@0"
I20260808 05:07:14.044508 8224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:14.068460 8224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:14.068811 8224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:14.068959 8224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:14.069212 8224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:14.069577 8224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:14.069612 8224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:14.069658 8224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:14.069685 8224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:14.075387 8224 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.195:32829
I20260808 05:07:14.075492 8409 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.195:32829 every 8 connection(s)
I20260808 05:07:14.075834 8224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/data/info.pb
I20260808 05:07:14.078140 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 8224
I20260808 05:07:14.078279 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/wal/instance
I20260808 05:07:14.078524 11547 external_mini_cluster.cc:1428] Setting key 07712345250a12afbf40c1880f787d13
I20260808 05:07:14.081449 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.076663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:39995 (local address 127.11.70.254:35729)
0808 05:07:14.076734 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:14.076736 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:14.077017 (+ 281us) server_negotiation.cc:407] Connection header received
0808 05:07:14.077513 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:14.077514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:14.077524 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:14.077578 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:14.078263 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.079029 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.080022 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.080238 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.080317 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.081156 (+ 839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:14.081158 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:14.081158 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:14.081162 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:14.081178 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:14.081182 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:14.081229 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:14.081344 (+ 115us) server_negotiation.cc:299] Negotiation successful
0808 05:07:14.081377 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:07:14.081673 8415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.076659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:35729 (local address 127.11.70.195:39995)
0808 05:07:14.076891 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:14.076928 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:14.077422 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:14.077633 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:14.077636 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:14.077644 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:14.078163 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.078168 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.079126 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.079127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.079918 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.079921 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.080329 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.080330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.080470 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.081014 (+ 544us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:07:14.081015 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:14.081043 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:07:14.081067 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:14.081230 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:14.081236 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:14.081239 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:14.081308 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 05:07:14.081421 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":121,"threads_started":1}
I20260808 05:07:14.082191 8411 heartbeater.cc:347] Connected to a master server at 127.11.70.254:35729
I20260808 05:07:14.082275 8411 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:14.082527 8411 heartbeater.cc:511] Master 127.11.70.254:35729 requested a full tablet report, sending...
I20260808 05:07:14.082935 7772 ts_manager.cc:194] Registered new tserver with Master: fbfbfb29aba740068706c2b4c4682c17 (127.11.70.195:32829)
I20260808 05:07:14.083320 7772 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.70.195:39995
I20260808 05:07:14.090251 11547 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:07:14.094924 7829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.091737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45104 (local address 127.11.70.254:35729)
0808 05:07:14.091829 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:14.091831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:14.091932 (+ 101us) server_negotiation.cc:407] Connection header received
0808 05:07:14.092011 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:14.092012 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:14.092024 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:14.092081 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:14.092268 (+ 187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.092748 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.093508 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.093718 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.093812 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.094640 (+ 828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:14.094642 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:14.094642 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:14.094646 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:14.094661 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:14.094665 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:14.094712 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:14.094805 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 05:07:14.094831 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260808 05:07:14.096443 7772 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:07:14.098150 7772 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:07:14.104983 8425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.100618 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60156 (local address 127.11.70.193:40663)
0808 05:07:14.100965 (+ 347us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:14.100970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:14.100979 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:14.101020 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:14.101028 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:14.101040 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:14.101201 (+ 161us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:14.101373 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.102547 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.103795 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.104514 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.104596 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.104697 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:14.104854 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 05:07:14.104894 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":307,"thread_start_us":139,"threads_started":1}
I20260808 05:07:14.105002 8424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.100522 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:40663 (local address 127.0.0.1:60156)
0808 05:07:14.100698 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:14.100742 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:14.100809 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:14.101205 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:14.101209 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:14.101211 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:14.101280 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.101282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.102632 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.102632 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.103708 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.103711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.104628 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.104630 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.104729 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.104746 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 05:07:14.104829 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:07:14.104894 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"mutex_wait_us":7,"thread_start_us":76,"threads_started":1}
I20260808 05:07:14.105002 8428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.100742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:38895 (local address 127.0.0.1:51154)
0808 05:07:14.100953 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:14.100964 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:14.101022 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:14.101485 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:14.101486 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:14.101488 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:14.101521 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.101522 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.102738 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.102739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.103637 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.103639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.104631 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.104631 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.104729 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.104746 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 05:07:14.104829 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:07:14.104894 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":194,"mutex_wait_us":33,"thread_start_us":99,"threads_started":1}
I20260808 05:07:14.105638 8429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.100985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51154 (local address 127.11.70.194:38895)
0808 05:07:14.101340 (+ 355us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:14.101345 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:14.101354 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:14.101391 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:14.101393 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:14.101409 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:14.101488 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:14.101582 (+ 94us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.102659 (+ 1077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.103732 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.104514 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.104596 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.104692 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:14.105226 (+ 534us) server_negotiation.cc:299] Negotiation successful
0808 05:07:14.105268 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":100,"threads_started":1}
I20260808 05:07:14.105808 7954 tablet_service.cc:1467] Processing CreateTablet for tablet b47a79b4f82447809f47ebbc6698e364 (DEFAULT_TABLE table=test-table [id=d278eaa910ab44b08c801b9d3dd3b842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:14.106235 7954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b47a79b4f82447809f47ebbc6698e364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:14.106247 8423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.100527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.195:32829 (local address 127.0.0.1:45214)
0808 05:07:14.100852 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:14.100862 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:14.100905 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:14.101365 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:14.101366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:14.101367 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:14.101426 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.101428 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.102338 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.102339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.103708 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.103711 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.106001 (+ 2290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.106002 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.106065 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.106068 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:07:14.106128 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:07:14.106168 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"mutex_wait_us":7,"thread_start_us":64,"threads_started":1}
I20260808 05:07:14.106268 8127 tablet_service.cc:1467] Processing CreateTablet for tablet b47a79b4f82447809f47ebbc6698e364 (DEFAULT_TABLE table=test-table [id=d278eaa910ab44b08c801b9d3dd3b842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:14.106528 8426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.100695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45214 (local address 127.11.70.195:32829)
0808 05:07:14.101146 (+ 451us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:14.101151 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:14.101162 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:07:14.101203 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:14.101205 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:14.101221 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:14.101294 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:14.101536 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.102238 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.104735 (+ 2497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.105807 (+ 1072us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.105872 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.105967 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:14.106160 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 05:07:14.106205 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":410,"thread_start_us":141,"threads_started":1}
I20260808 05:07:14.106647 8127 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b47a79b4f82447809f47ebbc6698e364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:14.107142 8314 tablet_service.cc:1467] Processing CreateTablet for tablet b47a79b4f82447809f47ebbc6698e364 (DEFAULT_TABLE table=test-table [id=d278eaa910ab44b08c801b9d3dd3b842]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:07:14.107499 8314 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b47a79b4f82447809f47ebbc6698e364. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:14.109161 8430 tablet_bootstrap.cc:492] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf: Bootstrap starting.
I20260808 05:07:14.109948 8430 tablet_bootstrap.cc:654] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:14.110330 8430 log.cc:824] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:14.110371 8431 tablet_bootstrap.cc:492] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: Bootstrap starting.
I20260808 05:07:14.110904 8433 tablet_bootstrap.cc:492] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: Bootstrap starting.
I20260808 05:07:14.111354 8431 tablet_bootstrap.cc:654] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:14.111533 8430 tablet_bootstrap.cc:492] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf: No bootstrap required, opened a new log
I20260808 05:07:14.111562 8433 tablet_bootstrap.cc:654] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:14.111610 8430 ts_tablet_manager.cc:1397] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 05:07:14.111685 8431 log.cc:824] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:14.111917 8433 log.cc:824] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:14.112483 8431 tablet_bootstrap.cc:492] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: No bootstrap required, opened a new log
I20260808 05:07:14.112564 8431 ts_tablet_manager.cc:1397] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:07:14.112860 8433 tablet_bootstrap.cc:492] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: No bootstrap required, opened a new log
I20260808 05:07:14.112986 8433 ts_tablet_manager.cc:1397] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:14.113765 8430 raft_consensus.cc:348] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } }
I20260808 05:07:14.113956 8430 raft_consensus.cc:374] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:14.114012 8430 raft_consensus.cc:729] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31c9f9ff061241d59e739da1a9fd9fdf, State: Initialized, Role: FOLLOWER
I20260808 05:07:14.114135 8430 consensus_queue.cc:260] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } }
I20260808 05:07:14.114431 8430 ts_tablet_manager.cc:1428] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:14.114595 8037 heartbeater.cc:503] Master 127.11.70.254:35729 was elected leader, sending a full tablet report...
I20260808 05:07:14.115298 8431 raft_consensus.cc:348] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } }
I20260808 05:07:14.115458 8431 raft_consensus.cc:374] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:14.115499 8431 raft_consensus.cc:729] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cbac1f54df24eb8bdc21d1ad93d2795, State: Initialized, Role: FOLLOWER
I20260808 05:07:14.115613 8431 consensus_queue.cc:260] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } }
I20260808 05:07:14.115902 8431 ts_tablet_manager.cc:1428] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: Time spent starting tablet: real 0.003s user 0.001s sys 0.003s
I20260808 05:07:14.115937 8221 heartbeater.cc:503] Master 127.11.70.254:35729 was elected leader, sending a full tablet report...
I20260808 05:07:14.115926 8433 raft_consensus.cc:348] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } }
I20260808 05:07:14.116075 8433 raft_consensus.cc:374] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:14.116154 8433 raft_consensus.cc:729] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbfbfb29aba740068706c2b4c4682c17, State: Initialized, Role: FOLLOWER
I20260808 05:07:14.116291 8433 consensus_queue.cc:260] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } }
I20260808 05:07:14.116547 8433 ts_tablet_manager.cc:1428] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:07:14.116590 8411 heartbeater.cc:503] Master 127.11.70.254:35729 was elected leader, sending a full tablet report...
W20260808 05:07:14.170697 8222 tablet.cc:2369] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:07:14.210109 8438 raft_consensus.cc:482] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:07:14.210294 8438 raft_consensus.cc:504] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } }
I20260808 05:07:14.210887 8438 leader_election.cc:288] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31c9f9ff061241d59e739da1a9fd9fdf (127.11.70.193:40663), 3cbac1f54df24eb8bdc21d1ad93d2795 (127.11.70.194:38895)
I20260808 05:07:14.215014 8425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.211210 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:46667 (local address 127.11.70.193:40663)
0808 05:07:14.211260 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:14.211262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:14.211275 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:07:14.211354 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:14.211355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:14.211369 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:14.211433 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:14.211678 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.212416 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.213956 (+ 1540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.214611 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.214678 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.214687 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:14.214891 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 05:07:14.214937 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:07:14.215014 8429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.211252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.70.195:39013 (local address 127.11.70.194:38895)
0808 05:07:14.211304 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:14.211306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:14.211561 (+ 255us) server_negotiation.cc:407] Connection header received
0808 05:07:14.211626 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:14.211627 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:14.211643 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:14.211710 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:07:14.211958 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.212640 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.213955 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.214558 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.214678 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.214687 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:14.214891 (+ 204us) server_negotiation.cc:299] Negotiation successful
0808 05:07:14.214937 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:07:14.215042 8439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.211178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.194:38895 (local address 127.11.70.195:39013)
0808 05:07:14.211403 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:14.211437 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:14.211512 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:14.211785 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:14.211786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:14.211788 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:14.211861 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.211862 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.212736 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.212737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.213862 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.213864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.214705 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.214706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.214806 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.214810 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:07:14.214871 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 05:07:14.214919 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"mutex_wait_us":23,"thread_start_us":155,"threads_started":1}
I20260808 05:07:14.215046 8415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.211132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:40663 (local address 127.11.70.195:46667)
0808 05:07:14.211214 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:14.211228 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:14.211280 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:14.211468 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:14.211469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:14.211471 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:07:14.211558 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.211561 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.212524 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.212526 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.213823 (+ 1297us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:14.213827 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.214702 (+ 875us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.214703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:14.214784 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.214788 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:07:14.214866 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:07:14.214920 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":58,"mutex_wait_us":4}
I20260808 05:07:14.215495 8155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b47a79b4f82447809f47ebbc6698e364" candidate_uuid: "fbfbfb29aba740068706c2b4c4682c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" is_pre_election: true
I20260808 05:07:14.215690 8155 raft_consensus.cc:2454] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfbfb29aba740068706c2b4c4682c17 in term 0.
I20260808 05:07:14.215691 7980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b47a79b4f82447809f47ebbc6698e364" candidate_uuid: "fbfbfb29aba740068706c2b4c4682c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" is_pre_election: true
I20260808 05:07:14.215874 7980 raft_consensus.cc:2454] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fbfbfb29aba740068706c2b4c4682c17 in term 0.
I20260808 05:07:14.215952 8248 leader_election.cc:302] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cbac1f54df24eb8bdc21d1ad93d2795, fbfbfb29aba740068706c2b4c4682c17; no voters:
I20260808 05:07:14.216102 8438 raft_consensus.cc:2781] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:07:14.216154 8438 raft_consensus.cc:482] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:07:14.216188 8438 raft_consensus.cc:3037] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:14.216948 8438 raft_consensus.cc:504] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } }
I20260808 05:07:14.217120 8438 leader_election.cc:288] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [CANDIDATE]: Term 1 election: Requested vote from peers 31c9f9ff061241d59e739da1a9fd9fdf (127.11.70.193:40663), 3cbac1f54df24eb8bdc21d1ad93d2795 (127.11.70.194:38895)
I20260808 05:07:14.217278 7980 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b47a79b4f82447809f47ebbc6698e364" candidate_uuid: "fbfbfb29aba740068706c2b4c4682c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31c9f9ff061241d59e739da1a9fd9fdf"
I20260808 05:07:14.217285 8155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b47a79b4f82447809f47ebbc6698e364" candidate_uuid: "fbfbfb29aba740068706c2b4c4682c17" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795"
I20260808 05:07:14.217365 7980 raft_consensus.cc:3037] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:14.217386 8155 raft_consensus.cc:3037] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:14.218251 8155 raft_consensus.cc:2454] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfbfb29aba740068706c2b4c4682c17 in term 1.
I20260808 05:07:14.218333 7980 raft_consensus.cc:2454] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fbfbfb29aba740068706c2b4c4682c17 in term 1.
I20260808 05:07:14.218415 8248 leader_election.cc:302] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3cbac1f54df24eb8bdc21d1ad93d2795, fbfbfb29aba740068706c2b4c4682c17; no voters:
I20260808 05:07:14.218544 8438 raft_consensus.cc:2781] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:14.218760 8438 raft_consensus.cc:686] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 1 LEADER]: Becoming Leader. State: Replica: fbfbfb29aba740068706c2b4c4682c17, State: Running, Role: LEADER
I20260808 05:07:14.218858 8438 consensus_queue.cc:237] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } }
I20260808 05:07:14.219861 7771 catalog_manager.cc:5495] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 reported cstate change: term changed from 0 to 1, leader changed from <none> to fbfbfb29aba740068706c2b4c4682c17 (127.11.70.195). New cstate: current_term: 1 leader_uuid: "fbfbfb29aba740068706c2b4c4682c17" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fbfbfb29aba740068706c2b4c4682c17" member_type: VOTER last_known_addr { host: "127.11.70.195" port: 32829 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 } health_report { overall_health: UNKNOWN } } }
W20260808 05:07:14.246290 8038 tablet.cc:2369] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:07:14.252168 8426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.249765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45230 (local address 127.11.70.195:32829)
0808 05:07:14.249834 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:14.249836 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:14.249846 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:07:14.249895 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:14.249895 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:14.249916 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:14.249986 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:14.250112 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.250617 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.251359 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:14.251584 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:14.251642 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:14.251792 (+ 150us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:14.251895 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:14.251957 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:14.251993 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 05:07:14.252015 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:07:14.254145 7980 raft_consensus.cc:1261] T b47a79b4f82447809f47ebbc6698e364 P 31c9f9ff061241d59e739da1a9fd9fdf [term 1 FOLLOWER]: Refusing update from remote peer fbfbfb29aba740068706c2b4c4682c17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:14.254146 8155 raft_consensus.cc:1261] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [term 1 FOLLOWER]: Refusing update from remote peer fbfbfb29aba740068706c2b4c4682c17: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:14.254549 8440 consensus_queue.cc:1035] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3cbac1f54df24eb8bdc21d1ad93d2795" member_type: VOTER last_known_addr { host: "127.11.70.194" port: 38895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:14.254724 8438 consensus_queue.cc:1035] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31c9f9ff061241d59e739da1a9fd9fdf" member_type: VOTER last_known_addr { host: "127.11.70.193" port: 40663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:14.257058 8445 mvcc.cc:205] Tried to move back new op lower bound from 7316134437902012416 to 7316134437761265664. Current Snapshot: MvccSnapshot[applied={T|T < 7316134437902012416}]
I20260808 05:07:14.257117 8447 mvcc.cc:205] Tried to move back new op lower bound from 7316134437902012416 to 7316134437761265664. Current Snapshot: MvccSnapshot[applied={T|T < 7316134437902012416}]
I20260808 05:07:14.259750 7771 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:45104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:14.259865 7771 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:45104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:07:14.260651 7771 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 72011d376cd34a60bb2b42c54ec46c9d: Sending DeleteTablet for 3 replicas of tablet b47a79b4f82447809f47ebbc6698e364
I20260808 05:07:14.261014 7954 tablet_service.cc:1514] Processing DeleteTablet for tablet b47a79b4f82447809f47ebbc6698e364 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:14 UTC) from {username='slave'} at 127.0.0.1:60156
I20260808 05:07:14.261037 8127 tablet_service.cc:1514] Processing DeleteTablet for tablet b47a79b4f82447809f47ebbc6698e364 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:14 UTC) from {username='slave'} at 127.0.0.1:51154
I20260808 05:07:14.261273 8314 tablet_service.cc:1514] Processing DeleteTablet for tablet b47a79b4f82447809f47ebbc6698e364 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:07:14 UTC) from {username='slave'} at 127.0.0.1:45214
I20260808 05:07:14.261373 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 7857
I20260808 05:07:14.261482 8460 tablet_replica.cc:330] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: stopping tablet replica
I20260808 05:07:14.264101 8460 raft_consensus.cc:2229] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:07:14.264276 8460 raft_consensus.cc:2258] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:14.264787 8460 ts_tablet_manager.cc:1905] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:14.264485 8461 tablet_replica.cc:330] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: stopping tablet replica
I20260808 05:07:14.266709 8461 raft_consensus.cc:2229] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:07:14.266937 8461 raft_consensus.cc:2258] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:07:14.267089 8460 ts_tablet_manager.cc:1918] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:14.267176 8460 log.cc:1196] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-1/wal/wals/b47a79b4f82447809f47ebbc6698e364
I20260808 05:07:14.267462 8460 ts_tablet_manager.cc:1939] T b47a79b4f82447809f47ebbc6698e364 P 3cbac1f54df24eb8bdc21d1ad93d2795: Deleting consensus metadata
I20260808 05:07:14.268316 8461 ts_tablet_manager.cc:1905] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:07:14.270004 8461 ts_tablet_manager.cc:1918] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:07:14.270087 8461 log.cc:1196] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: Deleting WAL directory at /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165386228479-11547-0/minicluster-data/ts-2/wal/wals/b47a79b4f82447809f47ebbc6698e364
I20260808 05:07:14.270088 7754 catalog_manager.cc:4841] TS 3cbac1f54df24eb8bdc21d1ad93d2795 (127.11.70.194:38895): tablet b47a79b4f82447809f47ebbc6698e364 (table test-table [id=d278eaa910ab44b08c801b9d3dd3b842]) successfully deleted
I20260808 05:07:14.270358 8461 ts_tablet_manager.cc:1939] T b47a79b4f82447809f47ebbc6698e364 P fbfbfb29aba740068706c2b4c4682c17: Deleting consensus metadata
I20260808 05:07:14.270836 7754 catalog_manager.cc:4841] TS fbfbfb29aba740068706c2b4c4682c17 (127.11.70.195:32829): tablet b47a79b4f82447809f47ebbc6698e364 (table test-table [id=d278eaa910ab44b08c801b9d3dd3b842]) successfully deleted
W20260808 05:07:14.275290 7755 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.11.70.193:40663 (error 108)
I20260808 05:07:14.275516 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 8040
I20260808 05:07:14.275851 8428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:14.275696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.193:40663 (local address 127.0.0.1:60172)
0808 05:07:14.275763 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:14.275806 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.193:40663: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 05:07:14.275967 7755 catalog_manager.cc:4584] TS 31c9f9ff061241d59e739da1a9fd9fdf (127.11.70.193:40663): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b47a79b4f82447809f47ebbc6698e364: Network error: Client connection negotiation failed: client connection to 127.11.70.193:40663: connect: Connection refused (error 111)
I20260808 05:07:14.294739 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 8224
I20260808 05:07:14.306318 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 7732
2026-08-08T05:07:14Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (886 ms)
[----------] 6 tests from EncryptionPolicyTest (9651 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:14 dist-test-slave-7kzw krb5kdc[8465](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:14 dist-test-slave-7kzw krb5kdc[8465](info): set up 2 sockets
Aug 08 05:07:14 dist-test-slave-7kzw krb5kdc[8465](info): commencing operation
krb5kdc: starting...
W20260808 05:07:15.532294 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.203s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:15 dist-test-slave-7kzw krb5kdc[8465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:15.665704 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46689
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45391
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:15.751865 8486 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:15.752080 8486 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:15.752103 8486 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:15.753167 8486 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:15.753201 8486 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:15.753216 8486 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:15.753229 8486 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:15.753242 8486 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:15.754709 8486 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45391
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46689
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8486
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:15.754913 8486 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:15.755086 8486 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:15.760299 8502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:15.760354 8496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:15.760304 8499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:15.760519 8486 server_base.cc:1034] running on GCE node
I20260808 05:07:15.760784 8486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:15.761092 8486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:15.762295 8486 hybrid_clock.cc:648] HybridClock initialized: now 1786165635762275 us; error 29 us; skew 500 ppm
Aug 08 05:07:15 dist-test-slave-7kzw krb5kdc[8465](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165635, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:15.765048 8486 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:15.765532 8486 webserver.cc:460] Webserver started at http://127.0.0.1:40905/ using document root <none> and password file <none>
I20260808 05:07:15.765795 8486 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:15.765870 8486 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:15.766027 8486 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:15.767194 8486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "bef0cce5172b44799ad7962403d5c4a0"
format_stamp: "Formatted at 2026-08-08 05:07:15 on dist-test-slave-7kzw"
server_key: "2e55dfcf8ef02f4a786f905a3f0ef2b4"
server_key_iv: "2ab6d9f50f7e1174e335dc6de25494c8"
server_key_version: "encryptionkey@0"
I20260808 05:07:15.767611 8486 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "bef0cce5172b44799ad7962403d5c4a0"
format_stamp: "Formatted at 2026-08-08 05:07:15 on dist-test-slave-7kzw"
server_key: "2e55dfcf8ef02f4a786f905a3f0ef2b4"
server_key_iv: "2ab6d9f50f7e1174e335dc6de25494c8"
server_key_version: "encryptionkey@0"
I20260808 05:07:15.769078 8486 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:07:15.770020 8511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:15.770236 8486 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:15.770365 8486 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "bef0cce5172b44799ad7962403d5c4a0"
format_stamp: "Formatted at 2026-08-08 05:07:15 on dist-test-slave-7kzw"
server_key: "2e55dfcf8ef02f4a786f905a3f0ef2b4"
server_key_iv: "2ab6d9f50f7e1174e335dc6de25494c8"
server_key_version: "encryptionkey@0"
I20260808 05:07:15.770454 8486 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:15.791244 8486 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:15.793967 8486 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:15.794162 8486 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:15.799365 8486 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46689
I20260808 05:07:15.799400 8578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46689 every 8 connection(s)
I20260808 05:07:15.799816 8486 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:15.800787 8579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:15.802517 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 8486
I20260808 05:07:15.802651 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:15.802886 11547 external_mini_cluster.cc:1428] Setting key 047ff5e5a4da05605245ba701524d89e
I20260808 05:07:15.803562 8579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0: Bootstrap starting.
I20260808 05:07:15.804183 8579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:15.804546 8579 log.cc:824] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:15.805371 8579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0: No bootstrap required, opened a new log
I20260808 05:07:15.807633 8579 raft_consensus.cc:348] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0cce5172b44799ad7962403d5c4a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46689 } }
I20260808 05:07:15.807840 8579 raft_consensus.cc:374] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:15.807885 8579 raft_consensus.cc:729] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bef0cce5172b44799ad7962403d5c4a0, State: Initialized, Role: FOLLOWER
I20260808 05:07:15.808041 8579 consensus_queue.cc:260] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0cce5172b44799ad7962403d5c4a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46689 } }
I20260808 05:07:15.808121 8579 raft_consensus.cc:388] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:15.808144 8579 raft_consensus.cc:482] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:15.808204 8579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:15.808947 8579 raft_consensus.cc:504] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0cce5172b44799ad7962403d5c4a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46689 } }
I20260808 05:07:15.809054 8579 leader_election.cc:302] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bef0cce5172b44799ad7962403d5c4a0; no voters:
I20260808 05:07:15.809253 8579 leader_election.cc:288] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:15.809336 8585 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:15.809538 8585 raft_consensus.cc:686] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [term 1 LEADER]: Becoming Leader. State: Replica: bef0cce5172b44799ad7962403d5c4a0, State: Running, Role: LEADER
I20260808 05:07:15.809557 8579 sys_catalog.cc:564] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:15.809648 8585 consensus_queue.cc:237] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0cce5172b44799ad7962403d5c4a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46689 } }
I20260808 05:07:15.810081 8585 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bef0cce5172b44799ad7962403d5c4a0. Latest consensus state: current_term: 1 leader_uuid: "bef0cce5172b44799ad7962403d5c4a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0cce5172b44799ad7962403d5c4a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46689 } } }
I20260808 05:07:15.810175 8585 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:15.810314 8586 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bef0cce5172b44799ad7962403d5c4a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0cce5172b44799ad7962403d5c4a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46689 } } }
I20260808 05:07:15.810411 8598 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:15.811004 8598 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:15.811282 8586 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0 [sys.catalog]: This master's current role is: LEADER
Aug 08 05:07:15 dist-test-slave-7kzw krb5kdc[8465](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165635, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:07:15.814599 8598 catalog_manager.cc:1347] Generated new cluster ID: 0840fb58587940fbbcf595769f7b1560
I20260808 05:07:15.814666 8598 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:15.816356 8583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:15.803496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36567 (local address 127.0.0.1:46689)
0808 05:07:15.803686 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:15.803736 (+ 50us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:15.803767 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:07:15.804257 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:15.804267 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:15.804340 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:15.804466 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:15.805387 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:15.806649 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:15.807819 (+ 1170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:15.808507 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:15.808609 (+ 102us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:15.812209 (+ 3600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:15.812213 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:15.812214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:15.812227 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:15.814379 (+ 2152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:15.814960 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:15.814964 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:15.814965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:15.815100 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:15.815371 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:15.815372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:15.815372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:15.815701 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:15.815882 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:15.816006 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 05:07:15.816120 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":88,"threads_started":1}
I20260808 05:07:15.817754 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:15.827531 8583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:15.819475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60657 (local address 127.0.0.1:46689)
0808 05:07:15.819515 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:15.819517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:15.819634 (+ 117us) server_negotiation.cc:407] Connection header received
0808 05:07:15.819732 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:15.819733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:15.819743 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:15.819774 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:15.820516 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:15.821285 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:15.822388 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:15.822748 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:15.822796 (+ 48us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:15.824402 (+ 1606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:15.824404 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:15.824404 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:15.824412 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:15.826047 (+ 1635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:15.826543 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:15.826544 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:15.826545 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:15.826605 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:15.826841 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:15.826842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:15.826842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:15.826978 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:15.827081 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:15.827356 (+ 275us) server_negotiation.cc:299] Negotiation successful
0808 05:07:15.827428 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:07:15.832829 8598 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:15.833410 8598 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:15.838619 8598 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bef0cce5172b44799ad7962403d5c4a0: Generated new TSK 0
I20260808 05:07:15.838845 8598 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:15.843921 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 8486
W20260808 05:07:15.859485 8463 connection.cc:535] client connection to 127.0.0.1:46689 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:46689): Connection reset by peer (error 104)
2026-08-08T05:07:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1544 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:15 dist-test-slave-7kzw krb5kdc[8620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:15 dist-test-slave-7kzw krb5kdc[8620](info): set up 2 sockets
Aug 08 05:07:15 dist-test-slave-7kzw krb5kdc[8620](info): commencing operation
krb5kdc: starting...
W20260808 05:07:17.122349 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:17 dist-test-slave-7kzw krb5kdc[8620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165637, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:17.253258 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39961
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33077
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39961
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:17.336328 8643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:17.336539 8643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:17.336563 8643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:17.337617 8643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:17.337652 8643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:17.337666 8643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:17.337678 8643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:17.337690 8643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:17.339223 8643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33077
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39961
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:17.339489 8643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:17.339730 8643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:17.344899 8654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:17.344923 8650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:17.345000 8643 server_base.cc:1034] running on GCE node
W20260808 05:07:17.344944 8652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:17.345307 8643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:17.345556 8643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:17.346695 8643 hybrid_clock.cc:648] HybridClock initialized: now 1786165637346657 us; error 51 us; skew 500 ppm
Aug 08 05:07:17 dist-test-slave-7kzw krb5kdc[8620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165637, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:17.353930 8643 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:17.354422 8643 webserver.cc:460] Webserver started at http://127.0.0.1:43271/ using document root <none> and password file <none>
I20260808 05:07:17.354719 8643 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:17.354775 8643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:17.354947 8643 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:17.356016 8643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "a7ad7ccca10b4cd686896666e7909d9f"
format_stamp: "Formatted at 2026-08-08 05:07:17 on dist-test-slave-7kzw"
server_key: "e1396a1ef9812e41eac3295c5061ed63"
server_key_iv: "e87b895e658813459d44889a7a9cee9d"
server_key_version: "encryptionkey@0"
I20260808 05:07:17.356388 8643 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "a7ad7ccca10b4cd686896666e7909d9f"
format_stamp: "Formatted at 2026-08-08 05:07:17 on dist-test-slave-7kzw"
server_key: "e1396a1ef9812e41eac3295c5061ed63"
server_key_iv: "e87b895e658813459d44889a7a9cee9d"
server_key_version: "encryptionkey@0"
I20260808 05:07:17.357831 8643 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:17.358623 8664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:17.358824 8643 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:17.358933 8643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "a7ad7ccca10b4cd686896666e7909d9f"
format_stamp: "Formatted at 2026-08-08 05:07:17 on dist-test-slave-7kzw"
server_key: "e1396a1ef9812e41eac3295c5061ed63"
server_key_iv: "e87b895e658813459d44889a7a9cee9d"
server_key_version: "encryptionkey@0"
I20260808 05:07:17.359019 8643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:17.393509 8643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:17.395856 8643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:17.396036 8643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:17.400911 8643 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39961
I20260808 05:07:17.400949 8738 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39961 every 8 connection(s)
I20260808 05:07:17.401332 8643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:17.402271 8739 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:17.404600 8739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f: Bootstrap starting.
I20260808 05:07:17.405205 8739 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:17.405516 8739 log.cc:824] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:17.406255 8739 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f: No bootstrap required, opened a new log
I20260808 05:07:17.408015 8739 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ad7ccca10b4cd686896666e7909d9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39961 } }
I20260808 05:07:17.408156 8739 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:17.408180 8739 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ad7ccca10b4cd686896666e7909d9f, State: Initialized, Role: FOLLOWER
I20260808 05:07:17.408344 8739 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ad7ccca10b4cd686896666e7909d9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39961 } }
I20260808 05:07:17.408411 8739 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:17.408432 8739 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:17.408504 8739 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:17.408771 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 8643
I20260808 05:07:17.408897 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:17.409121 11547 external_mini_cluster.cc:1428] Setting key cb134034d3ab046bc0e903767a4bc749
I20260808 05:07:17.409170 8739 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ad7ccca10b4cd686896666e7909d9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39961 } }
I20260808 05:07:17.409310 8739 leader_election.cc:302] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7ad7ccca10b4cd686896666e7909d9f; no voters:
I20260808 05:07:17.409483 8739 leader_election.cc:288] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:17.409579 8742 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:17.409765 8742 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [term 1 LEADER]: Becoming Leader. State: Replica: a7ad7ccca10b4cd686896666e7909d9f, State: Running, Role: LEADER
I20260808 05:07:17.409768 8739 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:17.409987 8742 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ad7ccca10b4cd686896666e7909d9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39961 } }
I20260808 05:07:17.410354 8742 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7ad7ccca10b4cd686896666e7909d9f. Latest consensus state: current_term: 1 leader_uuid: "a7ad7ccca10b4cd686896666e7909d9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ad7ccca10b4cd686896666e7909d9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39961 } } }
I20260808 05:07:17.410523 8742 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:17.410533 8744 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7ad7ccca10b4cd686896666e7909d9f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ad7ccca10b4cd686896666e7909d9f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39961 } } }
I20260808 05:07:17.410650 8744 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:17.411489 8762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:17.412060 8762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:17.413933 8762 catalog_manager.cc:1347] Generated new cluster ID: 55cacc1d98a54e63a2b310b6ba7846fc
I20260808 05:07:17.414031 8762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:17.415277 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:17.409760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51109 (local address 127.0.0.1:39961)
0808 05:07:17.410082 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:17.410104 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:17.410138 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:07:17.410264 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:17.410271 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:17.410335 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:17.410791 (+ 456us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:17.410908 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:17.412124 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:17.413002 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:17.413640 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:17.413767 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:17.414587 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:17.414590 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:17.414591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:17.414783 (+ 192us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:17.414815 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:17.414825 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:17.414926 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:17.415007 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 05:07:17.415036 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":73,"threads_started":1}
I20260808 05:07:17.416229 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:17.420881 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:17.417636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53251 (local address 127.0.0.1:39961)
0808 05:07:17.417674 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:17.417676 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:17.417805 (+ 129us) server_negotiation.cc:407] Connection header received
0808 05:07:17.417876 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:17.417877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:17.417887 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:17.417934 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:17.418054 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:17.418596 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:17.419433 (+ 837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:17.419800 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:17.419868 (+ 68us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:17.420635 (+ 767us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:17.420636 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:17.420636 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:17.420641 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:17.420656 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:17.420660 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:17.420714 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:17.420775 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 05:07:17.420787 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:07:17.437285 8762 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:17.437990 8762 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:17.444077 8762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7ad7ccca10b4cd686896666e7909d9f: Generated new TSK 0
I20260808 05:07:17.444268 8762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:17.447072 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 8643
W20260808 05:07:17.461706 8618 connection.cc:535] client connection to 127.0.0.1:39961 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39961): Connection reset by peer (error 104)
2026-08-08T05:07:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1602 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:17 dist-test-slave-7kzw krb5kdc[8789](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:17 dist-test-slave-7kzw krb5kdc[8789](info): set up 2 sockets
Aug 08 05:07:17 dist-test-slave-7kzw krb5kdc[8789](info): commencing operation
krb5kdc: starting...
W20260808 05:07:18.680945 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:18 dist-test-slave-7kzw krb5kdc[8789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165638, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:18.814111 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45047
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:32841
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45047
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:18.899701 8806 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:18.899927 8806 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:18.899951 8806 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:18.901047 8806 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:18.901084 8806 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:18.901098 8806 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:18.901111 8806 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:18.901124 8806 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:18.902661 8806 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:32841
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45047
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45047
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:18.903127 8806 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:18.903445 8806 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:18.908735 8812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:18.908767 8811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:18.908739 8815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:18.908936 8806 server_base.cc:1034] running on GCE node
I20260808 05:07:18.909395 8806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:18.909755 8806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:18.910949 8806 hybrid_clock.cc:648] HybridClock initialized: now 1786165638910924 us; error 46 us; skew 500 ppm
Aug 08 05:07:18 dist-test-slave-7kzw krb5kdc[8789](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165638, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:18.914036 8806 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:18.914646 8806 webserver.cc:460] Webserver started at http://127.0.0.1:44539/ using document root <none> and password file <none>
I20260808 05:07:18.914911 8806 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:18.914995 8806 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:18.915180 8806 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:18.916389 8806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "34e53bd585c548a09db6a082d3680278"
format_stamp: "Formatted at 2026-08-08 05:07:18 on dist-test-slave-7kzw"
server_key: "79b5349e6b59555bdd9df2986e6f9e92"
server_key_iv: "c6c41b5b70e979031a9de8cbcddb6e50"
server_key_version: "encryptionkey@0"
I20260808 05:07:18.916837 8806 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "34e53bd585c548a09db6a082d3680278"
format_stamp: "Formatted at 2026-08-08 05:07:18 on dist-test-slave-7kzw"
server_key: "79b5349e6b59555bdd9df2986e6f9e92"
server_key_iv: "c6c41b5b70e979031a9de8cbcddb6e50"
server_key_version: "encryptionkey@0"
I20260808 05:07:18.918615 8806 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260808 05:07:18.919489 8826 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:18.919735 8806 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:18.919850 8806 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "34e53bd585c548a09db6a082d3680278"
format_stamp: "Formatted at 2026-08-08 05:07:18 on dist-test-slave-7kzw"
server_key: "79b5349e6b59555bdd9df2986e6f9e92"
server_key_iv: "c6c41b5b70e979031a9de8cbcddb6e50"
server_key_version: "encryptionkey@0"
I20260808 05:07:18.919943 8806 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:18.923337 8806 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:18.925783 8806 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:18.925948 8806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:18.931185 8806 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45047
I20260808 05:07:18.931227 8907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45047 every 8 connection(s)
I20260808 05:07:18.931674 8806 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:18.932632 8908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:18.935056 8908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278: Bootstrap starting.
I20260808 05:07:18.935676 8908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:18.936017 8908 log.cc:824] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:18.936771 8908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278: No bootstrap required, opened a new log
I20260808 05:07:18.938406 8908 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e53bd585c548a09db6a082d3680278" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45047 } }
I20260808 05:07:18.938613 8908 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:18.938671 8908 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e53bd585c548a09db6a082d3680278, State: Initialized, Role: FOLLOWER
I20260808 05:07:18.938843 8908 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e53bd585c548a09db6a082d3680278" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45047 } }
I20260808 05:07:18.938925 8908 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:18.938967 8908 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:18.939023 8908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:18.939571 8908 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e53bd585c548a09db6a082d3680278" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45047 } }
I20260808 05:07:18.939661 8908 leader_election.cc:302] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34e53bd585c548a09db6a082d3680278; no voters:
I20260808 05:07:18.939860 8908 leader_election.cc:288] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:18.939915 8913 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:18.940148 8908 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:18.940333 8913 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [term 1 LEADER]: Becoming Leader. State: Replica: 34e53bd585c548a09db6a082d3680278, State: Running, Role: LEADER
I20260808 05:07:18.940389 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 8806
I20260808 05:07:18.940481 8913 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e53bd585c548a09db6a082d3680278" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45047 } }
I20260808 05:07:18.940518 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:18.940762 11547 external_mini_cluster.cc:1428] Setting key 539f1eb441737f71f7b7d8b24445b4b8
I20260808 05:07:18.941171 8914 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34e53bd585c548a09db6a082d3680278" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e53bd585c548a09db6a082d3680278" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45047 } } }
I20260808 05:07:18.941277 8914 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:18.941679 8917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34e53bd585c548a09db6a082d3680278. Latest consensus state: current_term: 1 leader_uuid: "34e53bd585c548a09db6a082d3680278" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e53bd585c548a09db6a082d3680278" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45047 } } }
I20260808 05:07:18.941985 8917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278 [sys.catalog]: This master's current role is: LEADER
W20260808 05:07:18.942334 8941 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:07:18.942399 8941 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:18.942505 8931 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:18.942726 8931 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:18.943543 8936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:18.941448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34485 (local address 127.0.0.1:45047)
0808 05:07:18.941683 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:18.941693 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:18.941957 (+ 264us) server_negotiation.cc:407] Connection header received
0808 05:07:18.942113 (+ 156us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:18.942121 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:18.942157 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:18.942272 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:18.943067 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:18.943071 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:18.943071 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:18.943077 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:18.943120 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:18.943134 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:18.943207 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:18.943302 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 05:07:18.943346 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":62,"threads_started":1}
I20260808 05:07:18.944308 8931 catalog_manager.cc:1347] Generated new cluster ID: a127794f8efd4f87835095ff803858a9
I20260808 05:07:18.944368 8931 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:18.944515 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:18.947609 8936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:18.945994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34063 (local address 127.0.0.1:45047)
0808 05:07:18.946031 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:18.946033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:18.946669 (+ 636us) server_negotiation.cc:407] Connection header received
0808 05:07:18.946737 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:18.946738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:18.946743 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:18.946798 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:18.947416 (+ 618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:18.947416 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:18.947417 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:18.947420 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:18.947431 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:18.947435 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:18.947476 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:18.947537 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 05:07:18.947548 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:07:18.953450 8931 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:18.953615 8931 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:18.958143 8931 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34e53bd585c548a09db6a082d3680278: Generated new TSK 0
I20260808 05:07:18.958321 8931 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:18.959807 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 8806
2026-08-08T05:07:18Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1512 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:19 dist-test-slave-7kzw krb5kdc[8959](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:19 dist-test-slave-7kzw krb5kdc[8959](info): set up 2 sockets
Aug 08 05:07:19 dist-test-slave-7kzw krb5kdc[8959](info): commencing operation
krb5kdc: starting...
W20260808 05:07:20.215103 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:20 dist-test-slave-7kzw krb5kdc[8959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:20.341315 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35687
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45871
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35687
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:20.424170 8978 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:20.424407 8978 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:20.424444 8978 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:20.425591 8978 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:20.425664 8978 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:20.425688 8978 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:20.425709 8978 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:20.425740 8978 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:20.427248 8978 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45871
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35687
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35687
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8978
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:20.427544 8978 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:20.427776 8978 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:20.432909 8988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:20.432940 8984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:20.433149 8978 server_base.cc:1034] running on GCE node
W20260808 05:07:20.432927 8983 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:20.433517 8978 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:20.433818 8978 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:20.434985 8978 hybrid_clock.cc:648] HybridClock initialized: now 1786165640434952 us; error 51 us; skew 500 ppm
Aug 08 05:07:20 dist-test-slave-7kzw krb5kdc[8959](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165640, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:20.437446 8978 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:20.437891 8978 webserver.cc:460] Webserver started at http://127.0.0.1:45247/ using document root <none> and password file <none>
I20260808 05:07:20.438139 8978 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:20.438206 8978 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:20.438351 8978 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:20.439474 8978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "a3440972712c48958972c288cc9cfc6b"
format_stamp: "Formatted at 2026-08-08 05:07:20 on dist-test-slave-7kzw"
server_key: "eb07c35391acae5651af1a6a87d91baf"
server_key_iv: "f33f4fbc25630e6608000dd2a143cbd4"
server_key_version: "encryptionkey@0"
I20260808 05:07:20.439843 8978 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "a3440972712c48958972c288cc9cfc6b"
format_stamp: "Formatted at 2026-08-08 05:07:20 on dist-test-slave-7kzw"
server_key: "eb07c35391acae5651af1a6a87d91baf"
server_key_iv: "f33f4fbc25630e6608000dd2a143cbd4"
server_key_version: "encryptionkey@0"
I20260808 05:07:20.441205 8978 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:07:20.441924 8998 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:20.442118 8978 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:07:20.442230 8978 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "a3440972712c48958972c288cc9cfc6b"
format_stamp: "Formatted at 2026-08-08 05:07:20 on dist-test-slave-7kzw"
server_key: "eb07c35391acae5651af1a6a87d91baf"
server_key_iv: "f33f4fbc25630e6608000dd2a143cbd4"
server_key_version: "encryptionkey@0"
I20260808 05:07:20.442305 8978 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:20.463771 8978 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:20.465788 8978 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:20.465953 8978 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:20.470165 8978 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35687
I20260808 05:07:20.470204 9078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35687 every 8 connection(s)
I20260808 05:07:20.470580 8978 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:20.471454 9079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:20.473773 9079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b: Bootstrap starting.
I20260808 05:07:20.474370 9079 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:20.474702 9079 log.cc:824] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:20.475394 9079 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b: No bootstrap required, opened a new log
I20260808 05:07:20.476419 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 8978
I20260808 05:07:20.476542 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:20.476751 11547 external_mini_cluster.cc:1428] Setting key c12de979bb86847c7b853040adf33185
I20260808 05:07:20.477564 9079 raft_consensus.cc:348] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3440972712c48958972c288cc9cfc6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } }
I20260808 05:07:20.477710 9079 raft_consensus.cc:374] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:20.477735 9079 raft_consensus.cc:729] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3440972712c48958972c288cc9cfc6b, State: Initialized, Role: FOLLOWER
I20260808 05:07:20.477862 9079 consensus_queue.cc:260] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3440972712c48958972c288cc9cfc6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } }
I20260808 05:07:20.477963 9079 raft_consensus.cc:388] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:20.478009 9079 raft_consensus.cc:482] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:20.478082 9079 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:20.479125 9079 raft_consensus.cc:504] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3440972712c48958972c288cc9cfc6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } }
I20260808 05:07:20.479250 9079 leader_election.cc:302] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3440972712c48958972c288cc9cfc6b; no voters:
I20260808 05:07:20.479445 9079 leader_election.cc:288] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:20.479468 9087 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:20.479583 9087 raft_consensus.cc:686] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [term 1 LEADER]: Becoming Leader. State: Replica: a3440972712c48958972c288cc9cfc6b, State: Running, Role: LEADER
I20260808 05:07:20.479756 9079 sys_catalog.cc:564] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:20.479729 9087 consensus_queue.cc:237] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3440972712c48958972c288cc9cfc6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } }
I20260808 05:07:20.480199 9090 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3440972712c48958972c288cc9cfc6b. Latest consensus state: current_term: 1 leader_uuid: "a3440972712c48958972c288cc9cfc6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3440972712c48958972c288cc9cfc6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } } }
I20260808 05:07:20.480293 9090 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:20.480504 9099 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:20.480712 9088 sys_catalog.cc:455] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3440972712c48958972c288cc9cfc6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3440972712c48958972c288cc9cfc6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35687 } } }
I20260808 05:07:20.480849 9088 sys_catalog.cc:458] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:20.481046 9099 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:20.482870 9099 catalog_manager.cc:1347] Generated new cluster ID: 117e367c7f904a83b1e83592df3ed84f
I20260808 05:07:20.482928 9099 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:07:20 dist-test-slave-7kzw krb5kdc[8959](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165640, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:07:20.487522 9085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:20.477294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37313 (local address 127.0.0.1:35687)
0808 05:07:20.477507 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:20.477515 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:20.477541 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:07:20.477634 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:20.477639 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:20.477681 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:20.477833 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:20.478594 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:20.479629 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:20.480746 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:20.481339 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:20.481440 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:20.484128 (+ 2688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:20.484132 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:20.484133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:20.484144 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:20.485894 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:20.486234 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:20.486236 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:20.486237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:20.486344 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:20.486653 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:20.486654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:20.486654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:20.486950 (+ 296us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:20.487087 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:20.487178 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 05:07:20.487323 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":100,"threads_started":1}
I20260808 05:07:20.488507 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:20.506954 9085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:20.490105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49651 (local address 127.0.0.1:35687)
0808 05:07:20.490142 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:20.490144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:20.498666 (+ 8522us) server_negotiation.cc:407] Connection header received
0808 05:07:20.498703 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:20.498705 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:20.498718 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:20.498790 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:20.499437 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:20.500234 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:20.501226 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:20.501592 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:20.501668 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:20.503231 (+ 1563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:20.503233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:20.503233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:20.503241 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:20.505280 (+ 2039us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:20.505692 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:20.505694 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:20.505694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:20.505761 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:20.505968 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:20.505969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:20.505970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:20.506112 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:20.506677 (+ 565us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:20.506760 (+ 83us) server_negotiation.cc:299] Negotiation successful
0808 05:07:20.506847 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:07:20.517541 9099 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:20.518086 9099 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:20.530443 9099 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a3440972712c48958972c288cc9cfc6b: Generated new TSK 0
I20260808 05:07:20.530684 9099 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:20.539184 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 8978
2026-08-08T05:07:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1576 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:20 dist-test-slave-7kzw krb5kdc[9131](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:20 dist-test-slave-7kzw krb5kdc[9131](info): set up 2 sockets
Aug 08 05:07:20 dist-test-slave-7kzw krb5kdc[9131](info): commencing operation
krb5kdc: starting...
W20260808 05:07:21.855145 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.291s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:21 dist-test-slave-7kzw krb5kdc[9131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:21.985009 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39621
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42037
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:22.073033 9148 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:22.073318 9148 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:22.073364 9148 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:22.074769 9148 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:22.074839 9148 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:22.074867 9148 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:22.074900 9148 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:22.074934 9148 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:22.076635 9148 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42037
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9148
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:22.076962 9148 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:22.077250 9148 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:22.083062 9163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:22.083122 9157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:22.083074 9159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:22.083065 9148 server_base.cc:1034] running on GCE node
I20260808 05:07:22.083709 9148 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:22.084065 9148 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:22.085251 9148 hybrid_clock.cc:648] HybridClock initialized: now 1786165642085244 us; error 38 us; skew 500 ppm
Aug 08 05:07:22 dist-test-slave-7kzw krb5kdc[9131](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165642, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:22.088151 9148 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:22.088655 9148 webserver.cc:460] Webserver started at http://127.0.0.1:36011/ using document root <none> and password file <none>
I20260808 05:07:22.088925 9148 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:22.089002 9148 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:22.089164 9148 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:22.090330 9148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "650b49c52e7941c48b02e0616f2f88f7"
format_stamp: "Formatted at 2026-08-08 05:07:22 on dist-test-slave-7kzw"
server_key: "0a386f1193d28b48f8d8d6db9af544ce"
server_key_iv: "e1010af8add833a851dc8dc01677633a"
server_key_version: "encryptionkey@0"
I20260808 05:07:22.090744 9148 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "650b49c52e7941c48b02e0616f2f88f7"
format_stamp: "Formatted at 2026-08-08 05:07:22 on dist-test-slave-7kzw"
server_key: "0a386f1193d28b48f8d8d6db9af544ce"
server_key_iv: "e1010af8add833a851dc8dc01677633a"
server_key_version: "encryptionkey@0"
I20260808 05:07:22.092201 9148 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:22.093083 9171 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:22.093289 9148 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:22.093412 9148 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "650b49c52e7941c48b02e0616f2f88f7"
format_stamp: "Formatted at 2026-08-08 05:07:22 on dist-test-slave-7kzw"
server_key: "0a386f1193d28b48f8d8d6db9af544ce"
server_key_iv: "e1010af8add833a851dc8dc01677633a"
server_key_version: "encryptionkey@0"
I20260808 05:07:22.093498 9148 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:22.107635 9148 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:22.109761 9148 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:22.109951 9148 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:22.114866 9148 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39621
I20260808 05:07:22.114902 9243 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39621 every 8 connection(s)
I20260808 05:07:22.115311 9148 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:22.116310 9244 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:22.118587 9244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7: Bootstrap starting.
I20260808 05:07:22.119138 9244 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:22.119393 9244 log.cc:824] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:22.120105 9244 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7: No bootstrap required, opened a new log
I20260808 05:07:22.120810 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 9148
I20260808 05:07:22.120971 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:22.121198 11547 external_mini_cluster.cc:1428] Setting key 2012453bb9f8a162d2f2fcf1b0df6ee4
I20260808 05:07:22.122215 9244 raft_consensus.cc:348] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650b49c52e7941c48b02e0616f2f88f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39621 } }
I20260808 05:07:22.122406 9244 raft_consensus.cc:374] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:22.122449 9244 raft_consensus.cc:729] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 650b49c52e7941c48b02e0616f2f88f7, State: Initialized, Role: FOLLOWER
I20260808 05:07:22.122618 9244 consensus_queue.cc:260] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650b49c52e7941c48b02e0616f2f88f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39621 } }
I20260808 05:07:22.122713 9244 raft_consensus.cc:388] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:22.122737 9244 raft_consensus.cc:482] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:22.122809 9244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:22.123380 9244 raft_consensus.cc:504] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650b49c52e7941c48b02e0616f2f88f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39621 } }
I20260808 05:07:22.123481 9244 leader_election.cc:302] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 650b49c52e7941c48b02e0616f2f88f7; no voters:
I20260808 05:07:22.123677 9244 leader_election.cc:288] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:22.123703 9251 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:22.123824 9251 raft_consensus.cc:686] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [term 1 LEADER]: Becoming Leader. State: Replica: 650b49c52e7941c48b02e0616f2f88f7, State: Running, Role: LEADER
I20260808 05:07:22.123960 9244 sys_catalog.cc:564] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:22.123976 9251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650b49c52e7941c48b02e0616f2f88f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39621 } }
I20260808 05:07:22.124387 9251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 650b49c52e7941c48b02e0616f2f88f7. Latest consensus state: current_term: 1 leader_uuid: "650b49c52e7941c48b02e0616f2f88f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650b49c52e7941c48b02e0616f2f88f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39621 } } }
I20260808 05:07:22.124652 9251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:22.125146 9267 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:22.124567 9255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "650b49c52e7941c48b02e0616f2f88f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "650b49c52e7941c48b02e0616f2f88f7" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39621 } } }
I20260808 05:07:22.125414 9255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:22.125676 9267 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:22.127794 9267 catalog_manager.cc:1347] Generated new cluster ID: b1ca7f9f831549e6b476389f39a22084
I20260808 05:07:22.127859 9267 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:22.128271 9250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:22.121830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40807 (local address 127.0.0.1:39621)
0808 05:07:22.122030 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:22.122038 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:22.122067 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:07:22.122182 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:22.122189 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:22.122234 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:22.122360 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:22.122739 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:22.124562 (+ 1823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:22.125900 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:22.126580 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:22.126711 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:22.127508 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:22.127512 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:22.127512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:22.127772 (+ 260us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:22.127808 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:22.127824 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:22.127908 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:22.128016 (+ 108us) server_negotiation.cc:299] Negotiation successful
0808 05:07:22.128087 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":110,"threads_started":1}
I20260808 05:07:22.129348 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:22.134871 9250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:22.131123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41863 (local address 127.0.0.1:39621)
0808 05:07:22.131156 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:22.131158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:22.131248 (+ 90us) server_negotiation.cc:407] Connection header received
0808 05:07:22.131322 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:22.131323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:22.131332 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:22.131387 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:22.131551 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:22.132289 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:22.133409 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:22.133725 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:22.133798 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:22.134614 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:22.134615 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:22.134615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:22.134620 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:22.134634 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:22.134639 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:22.134690 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:22.134768 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 05:07:22.134792 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:07:22.137470 9267 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:22.138015 9267 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:22.147557 9267 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 650b49c52e7941c48b02e0616f2f88f7: Generated new TSK 0
I20260808 05:07:22.147787 9267 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:22.154915 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 9148
2026-08-08T05:07:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1615 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:22 dist-test-slave-7kzw krb5kdc[9297](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:22 dist-test-slave-7kzw krb5kdc[9297](info): set up 2 sockets
Aug 08 05:07:22 dist-test-slave-7kzw krb5kdc[9297](info): commencing operation
krb5kdc: starting...
W20260808 05:07:23.391455 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.211s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:23 dist-test-slave-7kzw krb5kdc[9297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:23.517728 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36741
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40715
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36741
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:23.604391 9313 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:23.604652 9313 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:23.604693 9313 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:23.605831 9313 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:23.605903 9313 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:23.605929 9313 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:23.605959 9313 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:23.605983 9313 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:23.607519 9313 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40715
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36741
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9313
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:23.607818 9313 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:23.608055 9313 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:23.613030 9323 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:23.613065 9321 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:23.613245 9320 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:23.613482 9313 server_base.cc:1034] running on GCE node
I20260808 05:07:23.613795 9313 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:23.614217 9313 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:23.615432 9313 hybrid_clock.cc:648] HybridClock initialized: now 1786165643615404 us; error 75 us; skew 500 ppm
Aug 08 05:07:23 dist-test-slave-7kzw krb5kdc[9297](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165643, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:23.621611 9313 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:23.622051 9313 webserver.cc:460] Webserver started at http://127.0.0.1:40639/ using document root <none> and password file <none>
I20260808 05:07:23.622308 9313 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:23.622381 9313 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:23.622575 9313 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:23.623713 9313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "d527d5fb18534288b892bec9f23ddc77"
format_stamp: "Formatted at 2026-08-08 05:07:23 on dist-test-slave-7kzw"
server_key: "5fecdca882b209b14f3d3bc7da450735"
server_key_iv: "7b2aa7e46cfcc72fcb9b99968a204625"
server_key_version: "encryptionkey@0"
I20260808 05:07:23.624084 9313 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "d527d5fb18534288b892bec9f23ddc77"
format_stamp: "Formatted at 2026-08-08 05:07:23 on dist-test-slave-7kzw"
server_key: "5fecdca882b209b14f3d3bc7da450735"
server_key_iv: "7b2aa7e46cfcc72fcb9b99968a204625"
server_key_version: "encryptionkey@0"
I20260808 05:07:23.625433 9313 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:23.626174 9331 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:23.626356 9313 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:07:23.626464 9313 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "d527d5fb18534288b892bec9f23ddc77"
format_stamp: "Formatted at 2026-08-08 05:07:23 on dist-test-slave-7kzw"
server_key: "5fecdca882b209b14f3d3bc7da450735"
server_key_iv: "7b2aa7e46cfcc72fcb9b99968a204625"
server_key_version: "encryptionkey@0"
I20260808 05:07:23.626572 9313 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:23.629864 9313 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:23.631769 9313 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:23.631934 9313 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:23.636631 9313 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36741
I20260808 05:07:23.636682 9399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36741 every 8 connection(s)
I20260808 05:07:23.637015 9313 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:23.637967 9400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:23.640311 9400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77: Bootstrap starting.
I20260808 05:07:23.640848 9400 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:23.641104 9400 log.cc:824] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:23.641788 9400 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77: No bootstrap required, opened a new log
I20260808 05:07:23.642987 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 9313
I20260808 05:07:23.643146 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:23.643386 11547 external_mini_cluster.cc:1428] Setting key 75c6f682a898239b651711edf06f2d1f
I20260808 05:07:23.643654 9400 raft_consensus.cc:348] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d527d5fb18534288b892bec9f23ddc77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36741 } }
I20260808 05:07:23.643889 9400 raft_consensus.cc:374] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:23.643981 9400 raft_consensus.cc:729] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d527d5fb18534288b892bec9f23ddc77, State: Initialized, Role: FOLLOWER
I20260808 05:07:23.644160 9400 consensus_queue.cc:260] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d527d5fb18534288b892bec9f23ddc77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36741 } }
I20260808 05:07:23.644261 9400 raft_consensus.cc:388] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:23.644297 9400 raft_consensus.cc:482] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:23.644344 9400 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:23.645458 9400 raft_consensus.cc:504] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d527d5fb18534288b892bec9f23ddc77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36741 } }
I20260808 05:07:23.645591 9400 leader_election.cc:302] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d527d5fb18534288b892bec9f23ddc77; no voters:
I20260808 05:07:23.645761 9400 leader_election.cc:288] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:23.645821 9406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:23.643925 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53421 (local address 127.0.0.1:36741)
0808 05:07:23.644230 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:23.644239 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:23.644272 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:07:23.644399 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:23.644405 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:23.644436 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:23.644576 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:23.645266 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:23.645270 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:23.645270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:23.645276 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:23.645324 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:23.645340 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:23.645420 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:23.645563 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:07:23.645611 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":149,"threads_started":1}
I20260808 05:07:23.646021 9400 sys_catalog.cc:564] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:23.645812 9407 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:23.646184 9407 raft_consensus.cc:686] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [term 1 LEADER]: Becoming Leader. State: Replica: d527d5fb18534288b892bec9f23ddc77, State: Running, Role: LEADER
I20260808 05:07:23.646281 9407 consensus_queue.cc:237] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d527d5fb18534288b892bec9f23ddc77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36741 } }
I20260808 05:07:23.646658 9409 sys_catalog.cc:455] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d527d5fb18534288b892bec9f23ddc77. Latest consensus state: current_term: 1 leader_uuid: "d527d5fb18534288b892bec9f23ddc77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d527d5fb18534288b892bec9f23ddc77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36741 } } }
I20260808 05:07:23.646824 9409 sys_catalog.cc:458] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:23.646945 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:23.646677 9408 sys_catalog.cc:455] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d527d5fb18534288b892bec9f23ddc77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d527d5fb18534288b892bec9f23ddc77" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36741 } } }
I20260808 05:07:23.647033 9408 sys_catalog.cc:458] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:23.647189 9418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:23.647898 9418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:23.649504 9418 catalog_manager.cc:1347] Generated new cluster ID: 13712b54d8344491a19f1189da5c1bfc
I20260808 05:07:23.649569 9418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:23.650297 9406 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:23.648866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49215 (local address 127.0.0.1:36741)
0808 05:07:23.648909 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:23.648911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:23.649244 (+ 333us) server_negotiation.cc:407] Connection header received
0808 05:07:23.649345 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:23.649346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:23.649351 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:23.649381 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:23.650052 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:23.650060 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:23.650060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:23.650065 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:23.650080 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:23.650084 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:23.650139 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:23.650221 (+ 82us) server_negotiation.cc:299] Negotiation successful
0808 05:07:23.650235 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:07:23.668335 9418 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:23.668519 9418 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:23.675868 9418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d527d5fb18534288b892bec9f23ddc77: Generated new TSK 0
I20260808 05:07:23.676065 9418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:23.684640 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 9313
2026-08-08T05:07:23Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1529 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:23 dist-test-slave-7kzw krb5kdc[9445](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:23 dist-test-slave-7kzw krb5kdc[9445](info): set up 2 sockets
Aug 08 05:07:23 dist-test-slave-7kzw krb5kdc[9445](info): commencing operation
krb5kdc: starting...
W20260808 05:07:24.938959 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.003s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:25 dist-test-slave-7kzw krb5kdc[9445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:25.070076 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33507
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44475
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:25.154996 9466 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:25.155205 9466 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:25.155228 9466 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:25.156308 9466 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:25.156345 9466 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:25.156359 9466 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:25.156373 9466 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:25.156384 9466 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:25.157815 9466 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44475
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9466
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:25.158003 9466 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:25.158195 9466 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:25.163121 9479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:25.163255 9466 server_base.cc:1034] running on GCE node
W20260808 05:07:25.163344 9476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:25.163121 9473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:25.163672 9466 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:25.163985 9466 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:25.165153 9466 hybrid_clock.cc:648] HybridClock initialized: now 1786165645165148 us; error 37 us; skew 500 ppm
Aug 08 05:07:25 dist-test-slave-7kzw krb5kdc[9445](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165645, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:25.167794 9466 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:25.168272 9466 webserver.cc:460] Webserver started at http://127.0.0.1:46701/ using document root <none> and password file <none>
I20260808 05:07:25.168529 9466 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:25.168598 9466 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:25.168756 9466 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:25.169826 9466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5"
format_stamp: "Formatted at 2026-08-08 05:07:25 on dist-test-slave-7kzw"
server_key: "94070cd666ee8d75e92d92cf713ffeb5"
server_key_iv: "1e7743fe6be6d849cb4c9c3a9b91589a"
server_key_version: "encryptionkey@0"
I20260808 05:07:25.170199 9466 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5"
format_stamp: "Formatted at 2026-08-08 05:07:25 on dist-test-slave-7kzw"
server_key: "94070cd666ee8d75e92d92cf713ffeb5"
server_key_iv: "1e7743fe6be6d849cb4c9c3a9b91589a"
server_key_version: "encryptionkey@0"
I20260808 05:07:25.171641 9466 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:25.172467 9490 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:25.172703 9466 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:07:25.172828 9466 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5"
format_stamp: "Formatted at 2026-08-08 05:07:25 on dist-test-slave-7kzw"
server_key: "94070cd666ee8d75e92d92cf713ffeb5"
server_key_iv: "1e7743fe6be6d849cb4c9c3a9b91589a"
server_key_version: "encryptionkey@0"
I20260808 05:07:25.172914 9466 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:25.187609 9466 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:25.190301 9466 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:25.190573 9466 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:25.195271 9466 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33507
I20260808 05:07:25.195313 9569 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33507 every 8 connection(s)
I20260808 05:07:25.195741 9466 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:25.196651 9571 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:25.199090 9571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5: Bootstrap starting.
I20260808 05:07:25.199697 9571 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:25.200031 9571 log.cc:824] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:25.200798 9571 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5: No bootstrap required, opened a new log
I20260808 05:07:25.202416 9571 raft_consensus.cc:348] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33507 } }
I20260808 05:07:25.202580 9571 raft_consensus.cc:374] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:25.202637 9571 raft_consensus.cc:729] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00c76a1f8e8540dcaf6f2eb33a6694e5, State: Initialized, Role: FOLLOWER
I20260808 05:07:25.202800 9571 consensus_queue.cc:260] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33507 } }
I20260808 05:07:25.202867 9571 raft_consensus.cc:388] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:25.202919 9571 raft_consensus.cc:482] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:25.202970 9571 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:25.203517 9571 raft_consensus.cc:504] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33507 } }
I20260808 05:07:25.203630 9571 leader_election.cc:302] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 00c76a1f8e8540dcaf6f2eb33a6694e5; no voters:
I20260808 05:07:25.203815 9571 leader_election.cc:288] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:25.203850 9574 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:25.204046 9574 raft_consensus.cc:686] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [term 1 LEADER]: Becoming Leader. State: Replica: 00c76a1f8e8540dcaf6f2eb33a6694e5, State: Running, Role: LEADER
I20260808 05:07:25.204082 9571 sys_catalog.cc:564] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:25.204144 9574 consensus_queue.cc:237] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33507 } }
I20260808 05:07:25.204738 9576 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 00c76a1f8e8540dcaf6f2eb33a6694e5. Latest consensus state: current_term: 1 leader_uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33507 } } }
I20260808 05:07:25.204843 9576 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:25.205090 9575 sys_catalog.cc:455] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "00c76a1f8e8540dcaf6f2eb33a6694e5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33507 } } }
I20260808 05:07:25.205171 9588 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:25.205273 9575 sys_catalog.cc:458] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:25.205770 9588 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:25.205936 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 9466
I20260808 05:07:25.206069 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:25.206307 11547 external_mini_cluster.cc:1428] Setting key be2d26fc4cc4a75fc307b8e55b15d49f
I20260808 05:07:25.207540 9588 catalog_manager.cc:1347] Generated new cluster ID: 03231582c8b847c1a8d85312aed04f0c
I20260808 05:07:25.207602 9588 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:07:25 dist-test-slave-7kzw krb5kdc[9445](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:07:25.220057 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:25.206862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:42075 (local address 127.0.0.1:33507)
0808 05:07:25.207034 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:25.207044 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:25.210696 (+ 3652us) server_negotiation.cc:407] Connection header received
0808 05:07:25.210836 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:25.210842 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:25.210888 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:25.211023 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:25.211707 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:25.212675 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:25.213446 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:25.213896 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:25.214017 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:25.216501 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:25.216506 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:25.216506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:25.216519 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:25.218271 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:25.218732 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:25.218739 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:25.218740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:25.218860 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:25.219143 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:25.219144 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:25.219145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:25.219410 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:25.219581 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:25.219703 (+ 122us) server_negotiation.cc:299] Negotiation successful
0808 05:07:25.219820 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":79,"threads_started":1}
I20260808 05:07:25.221077 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:25.228739 9588 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:25.229430 9588 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:25.232923 9599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:25.222432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:35063 (local address 127.0.0.1:33507)
0808 05:07:25.222496 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:25.222498 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:25.226675 (+ 4177us) server_negotiation.cc:407] Connection header received
0808 05:07:25.226749 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:25.226750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:25.226763 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:25.226820 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:25.227363 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:25.227843 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:25.228677 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:25.228984 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:25.229064 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:25.230242 (+ 1178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:25.230243 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:25.230243 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:25.230251 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:25.231695 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:25.232087 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:25.232089 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:25.232089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:25.232146 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:25.232378 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:25.232379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:25.232379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:25.232489 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:25.232614 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:25.232728 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 05:07:25.232804 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:07:25.236765 9588 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 00c76a1f8e8540dcaf6f2eb33a6694e5: Generated new TSK 0
I20260808 05:07:25.236945 9588 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:25.244194 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 9466
W20260808 05:07:25.257534 9443 connection.cc:535] client connection to 127.0.0.1:33507 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33507): Connection reset by peer (error 104)
2026-08-08T05:07:25Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1562 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:25 dist-test-slave-7kzw krb5kdc[9616](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:25 dist-test-slave-7kzw krb5kdc[9616](info): set up 2 sockets
Aug 08 05:07:25 dist-test-slave-7kzw krb5kdc[9616](info): commencing operation
krb5kdc: starting...
W20260808 05:07:26.484508 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.212s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:26 dist-test-slave-7kzw krb5kdc[9616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165646, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:26.613982 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35835
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35835
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:26.698544 9631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:26.698757 9631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:26.698782 9631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:26.699947 9631 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:26.699993 9631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:26.700007 9631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:26.700021 9631 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:26.700032 9631 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:26.701517 9631 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35835
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35835
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:26.701767 9631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:26.701997 9631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:26.707048 9642 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:26.707186 9631 server_base.cc:1034] running on GCE node
W20260808 05:07:26.707054 9646 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:26.707054 9643 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:26.707573 9631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:26.707871 9631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:26.709034 9631 hybrid_clock.cc:648] HybridClock initialized: now 1786165646709006 us; error 52 us; skew 500 ppm
Aug 08 05:07:26 dist-test-slave-7kzw krb5kdc[9616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165646, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:26.711836 9631 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:26.712358 9631 webserver.cc:460] Webserver started at http://127.0.0.1:44891/ using document root <none> and password file <none>
I20260808 05:07:26.712670 9631 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:26.712756 9631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:26.712913 9631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:26.714094 9631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "0cb4aecf14bb4515bb4b337beab1cfbb"
format_stamp: "Formatted at 2026-08-08 05:07:26 on dist-test-slave-7kzw"
server_key: "d554f6c23d721d34e9d095b6131beda5"
server_key_iv: "1c03560667d0568016b4d38ccbcb7e68"
server_key_version: "encryptionkey@0"
I20260808 05:07:26.714550 9631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "0cb4aecf14bb4515bb4b337beab1cfbb"
format_stamp: "Formatted at 2026-08-08 05:07:26 on dist-test-slave-7kzw"
server_key: "d554f6c23d721d34e9d095b6131beda5"
server_key_iv: "1c03560667d0568016b4d38ccbcb7e68"
server_key_version: "encryptionkey@0"
I20260808 05:07:26.716080 9631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:26.716966 9655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:26.717195 9631 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:26.717315 9631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "0cb4aecf14bb4515bb4b337beab1cfbb"
format_stamp: "Formatted at 2026-08-08 05:07:26 on dist-test-slave-7kzw"
server_key: "d554f6c23d721d34e9d095b6131beda5"
server_key_iv: "1c03560667d0568016b4d38ccbcb7e68"
server_key_version: "encryptionkey@0"
I20260808 05:07:26.717398 9631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:26.727833 9631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:26.730192 9631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:26.730361 9631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:26.734612 9631 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35835
I20260808 05:07:26.734678 9741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35835 every 8 connection(s)
I20260808 05:07:26.735073 9631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:26.735986 9742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:26.738353 9742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb: Bootstrap starting.
I20260808 05:07:26.738996 9742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:26.739289 9742 log.cc:824] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:26.739609 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 9631
I20260808 05:07:26.739748 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:26.739948 11547 external_mini_cluster.cc:1428] Setting key ff7edce81758371ec3fabf9c3931c78f
I20260808 05:07:26.740124 9742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb: No bootstrap required, opened a new log
I20260808 05:07:26.743150 9742 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb4aecf14bb4515bb4b337beab1cfbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35835 } }
I20260808 05:07:26.743335 9742 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:26.743366 9742 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cb4aecf14bb4515bb4b337beab1cfbb, State: Initialized, Role: FOLLOWER
I20260808 05:07:26.743485 9742 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb4aecf14bb4515bb4b337beab1cfbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35835 } }
I20260808 05:07:26.743579 9742 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:26.743613 9742 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:26.743662 9742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:26.744237 9742 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb4aecf14bb4515bb4b337beab1cfbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35835 } }
I20260808 05:07:26.744369 9742 leader_election.cc:302] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cb4aecf14bb4515bb4b337beab1cfbb; no voters:
I20260808 05:07:26.744525 9742 leader_election.cc:288] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:26.744583 9747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:26.744755 9742 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:26.744774 9747 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [term 1 LEADER]: Becoming Leader. State: Replica: 0cb4aecf14bb4515bb4b337beab1cfbb, State: Running, Role: LEADER
I20260808 05:07:26.744916 9747 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb4aecf14bb4515bb4b337beab1cfbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35835 } }
I20260808 05:07:26.745292 9747 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cb4aecf14bb4515bb4b337beab1cfbb. Latest consensus state: current_term: 1 leader_uuid: "0cb4aecf14bb4515bb4b337beab1cfbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb4aecf14bb4515bb4b337beab1cfbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35835 } } }
I20260808 05:07:26.745390 9747 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:26.745299 9748 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0cb4aecf14bb4515bb4b337beab1cfbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cb4aecf14bb4515bb4b337beab1cfbb" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35835 } } }
I20260808 05:07:26.745528 9748 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:26.746731 9746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:26.740509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:56879 (local address 127.0.0.1:35835)
0808 05:07:26.740708 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:26.740718 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:26.740764 (+ 46us) server_negotiation.cc:407] Connection header received
0808 05:07:26.741542 (+ 778us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:26.741552 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:26.741617 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:26.741779 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:26.742000 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:26.743447 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:26.744350 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:26.744977 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:26.745457 (+ 480us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:26.745902 (+ 445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:26.745906 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:26.745907 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:26.746127 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:26.746183 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:26.746201 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:26.746350 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:26.746494 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 05:07:26.746524 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":95,"threads_started":1}
W20260808 05:07:26.747069 9768 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:07:26.747118 9768 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:26.747170 9756 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:26.747418 9756 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:26.748060 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:26.750119 9756 catalog_manager.cc:1347] Generated new cluster ID: a94fe731cd224ba6aa381b3309d60f43
I20260808 05:07:26.750176 9756 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:26.753049 9746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:26.749595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:55089 (local address 127.0.0.1:35835)
0808 05:07:26.749641 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:26.749643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:26.749898 (+ 255us) server_negotiation.cc:407] Connection header received
0808 05:07:26.749997 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:26.749998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:26.750008 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:26.750058 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:26.750304 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:26.750878 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:26.751679 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:26.751924 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:26.752007 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:26.752754 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:26.752755 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:26.752755 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:26.752760 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:26.752776 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:26.752781 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:26.752843 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:26.752950 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 05:07:26.752961 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:07:26.761538 9756 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:26.762256 9756 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:26.769069 9756 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0cb4aecf14bb4515bb4b337beab1cfbb: Generated new TSK 0
I20260808 05:07:26.769299 9756 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:26.779002 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 9631
W20260808 05:07:26.793195 9613 connection.cc:535] client connection to 127.0.0.1:35835 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35835): Connection reset by peer (error 104)
2026-08-08T05:07:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1535 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:26 dist-test-slave-7kzw krb5kdc[9781](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:26 dist-test-slave-7kzw krb5kdc[9781](info): set up 2 sockets
Aug 08 05:07:26 dist-test-slave-7kzw krb5kdc[9781](info): commencing operation
krb5kdc: starting...
W20260808 05:07:28.040233 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.233s user 0.005s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:28 dist-test-slave-7kzw krb5kdc[9781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165648, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:28.177620 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39649
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39131
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39649
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:28.262486 9797 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:28.262745 9797 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:28.262789 9797 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:28.263934 9797 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:28.264000 9797 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:28.264041 9797 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:28.264098 9797 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:28.264129 9797 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:28.265666 9797 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39131
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39649
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39649
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9797
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:28.265949 9797 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:28.266181 9797 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:28.271549 9808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:28.271709 9797 server_base.cc:1034] running on GCE node
W20260808 05:07:28.271559 9807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:28.271551 9810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:28.272123 9797 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:28.272452 9797 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:28.273692 9797 hybrid_clock.cc:648] HybridClock initialized: now 1786165648273664 us; error 39 us; skew 500 ppm
Aug 08 05:07:28 dist-test-slave-7kzw krb5kdc[9781](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165648, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:28.276504 9797 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:28.277014 9797 webserver.cc:460] Webserver started at http://127.0.0.1:43081/ using document root <none> and password file <none>
I20260808 05:07:28.277237 9797 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:28.277283 9797 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:28.277387 9797 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:28.278580 9797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "0cf784a3bd2a476b9511acbe8d688f4d"
format_stamp: "Formatted at 2026-08-08 05:07:28 on dist-test-slave-7kzw"
server_key: "aee78fdff5ff9927436c759824d494c6"
server_key_iv: "8352e113d1249ff1ad1c99f4c1c01c46"
server_key_version: "encryptionkey@0"
I20260808 05:07:28.278939 9797 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "0cf784a3bd2a476b9511acbe8d688f4d"
format_stamp: "Formatted at 2026-08-08 05:07:28 on dist-test-slave-7kzw"
server_key: "aee78fdff5ff9927436c759824d494c6"
server_key_iv: "8352e113d1249ff1ad1c99f4c1c01c46"
server_key_version: "encryptionkey@0"
I20260808 05:07:28.280400 9797 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:07:28.281186 9820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:28.281378 9797 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:07:28.281468 9797 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "0cf784a3bd2a476b9511acbe8d688f4d"
format_stamp: "Formatted at 2026-08-08 05:07:28 on dist-test-slave-7kzw"
server_key: "aee78fdff5ff9927436c759824d494c6"
server_key_iv: "8352e113d1249ff1ad1c99f4c1c01c46"
server_key_version: "encryptionkey@0"
I20260808 05:07:28.281527 9797 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:28.284780 9797 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:28.287030 9797 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:28.287184 9797 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:28.291330 9797 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39649
I20260808 05:07:28.291379 9905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39649 every 8 connection(s)
I20260808 05:07:28.291714 9797 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:28.292588 9906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:28.293428 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 9797
I20260808 05:07:28.293558 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:28.293814 11547 external_mini_cluster.cc:1428] Setting key 84cda5f5dfd5b30d69465fb20efebeec
I20260808 05:07:28.296080 9906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d: Bootstrap starting.
I20260808 05:07:28.296324 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:28.294354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:53063 (local address 127.0.0.1:39649)
0808 05:07:28.294571 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:28.294578 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:28.294604 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:07:28.295022 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:28.295028 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:28.295053 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:28.295165 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:28.295817 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:28.295821 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:28.295821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:28.295824 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:28.295867 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:28.295877 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:28.295933 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:28.296026 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 05:07:28.296059 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":90,"threads_started":1}
I20260808 05:07:28.296828 9906 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:28.297158 9906 log.cc:824] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:28.297274 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:28.297870 9906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d: No bootstrap required, opened a new log
I20260808 05:07:28.300024 9906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf784a3bd2a476b9511acbe8d688f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39649 } }
I20260808 05:07:28.300195 9906 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:28.300246 9906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cf784a3bd2a476b9511acbe8d688f4d, State: Initialized, Role: FOLLOWER
I20260808 05:07:28.300369 9906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf784a3bd2a476b9511acbe8d688f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39649 } }
I20260808 05:07:28.300462 9906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:28.300508 9906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:28.300560 9906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:28.301098 9906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf784a3bd2a476b9511acbe8d688f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39649 } }
I20260808 05:07:28.301221 9906 leader_election.cc:302] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0cf784a3bd2a476b9511acbe8d688f4d; no voters:
I20260808 05:07:28.301400 9906 leader_election.cc:288] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:28.301440 9919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:28.301632 9919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [term 1 LEADER]: Becoming Leader. State: Replica: 0cf784a3bd2a476b9511acbe8d688f4d, State: Running, Role: LEADER
I20260808 05:07:28.301648 9906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:28.301750 9919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf784a3bd2a476b9511acbe8d688f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39649 } }
I20260808 05:07:28.302145 9922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0cf784a3bd2a476b9511acbe8d688f4d. Latest consensus state: current_term: 1 leader_uuid: "0cf784a3bd2a476b9511acbe8d688f4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf784a3bd2a476b9511acbe8d688f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39649 } } }
I20260808 05:07:28.302279 9922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:28.302139 9920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0cf784a3bd2a476b9511acbe8d688f4d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cf784a3bd2a476b9511acbe8d688f4d" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39649 } } }
I20260808 05:07:28.302455 9920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d [sys.catalog]: This master's current role is: LEADER
W20260808 05:07:28.303471 9942 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:07:28.303534 9942 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:28.303828 9933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:28.304071 9933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:28.304374 9911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:28.298660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:38171 (local address 127.0.0.1:39649)
0808 05:07:28.298693 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:28.298695 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:28.303208 (+ 4513us) server_negotiation.cc:407] Connection header received
0808 05:07:28.303317 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:28.303317 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:28.303324 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:28.303357 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:28.304060 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:28.304061 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:28.304062 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:28.304066 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:28.304081 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:28.304085 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:28.304133 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:28.304275 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 05:07:28.304290 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:07:28.305544 9933 catalog_manager.cc:1347] Generated new cluster ID: 2258127c5a344adaa7be4cd205dcb72a
I20260808 05:07:28.305598 9933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:28.316461 9933 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:28.316646 9933 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:28.322142 9933 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0cf784a3bd2a476b9511acbe8d688f4d: Generated new TSK 0
I20260808 05:07:28.322328 9933 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:28.328676 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 9797
2026-08-08T05:07:28Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1550 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:28 dist-test-slave-7kzw krb5kdc[9950](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:28 dist-test-slave-7kzw krb5kdc[9950](info): set up 2 sockets
Aug 08 05:07:28 dist-test-slave-7kzw krb5kdc[9950](info): commencing operation
krb5kdc: starting...
W20260808 05:07:29.581857 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:29 dist-test-slave-7kzw krb5kdc[9950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:29.722941 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38637
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35371
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38637
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:29.808779 9968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:29.809005 9968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:29.809029 9968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:29.810124 9968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:29.810159 9968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:29.810173 9968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:29.810186 9968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:29.810199 9968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:29.811717 9968 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35371
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38637
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38637
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:29.811923 9968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:29.812095 9968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:29.816938 9977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:29.816956 9976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:29.816941 9979 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:29.817219 9968 server_base.cc:1034] running on GCE node
I20260808 05:07:29.817587 9968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:29.817855 9968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:29.819001 9968 hybrid_clock.cc:648] HybridClock initialized: now 1786165649818986 us; error 28 us; skew 500 ppm
Aug 08 05:07:29 dist-test-slave-7kzw krb5kdc[9950](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165649, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:29.826177 9968 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:29.826704 9968 webserver.cc:460] Webserver started at http://127.0.0.1:44701/ using document root <none> and password file <none>
I20260808 05:07:29.826943 9968 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:29.826985 9968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:29.827080 9968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:29.828187 9968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "0d8ad769d93b4076aaab0750856a9791"
format_stamp: "Formatted at 2026-08-08 05:07:29 on dist-test-slave-7kzw"
server_key: "4a862d767805ee0f3002287f433c61e8"
server_key_iv: "a9630f2d6117294ade023194c1e01fdd"
server_key_version: "encryptionkey@0"
I20260808 05:07:29.828514 9968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "0d8ad769d93b4076aaab0750856a9791"
format_stamp: "Formatted at 2026-08-08 05:07:29 on dist-test-slave-7kzw"
server_key: "4a862d767805ee0f3002287f433c61e8"
server_key_iv: "a9630f2d6117294ade023194c1e01fdd"
server_key_version: "encryptionkey@0"
I20260808 05:07:29.829983 9968 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:29.830773 9988 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:29.830940 9968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:29.831051 9968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "0d8ad769d93b4076aaab0750856a9791"
format_stamp: "Formatted at 2026-08-08 05:07:29 on dist-test-slave-7kzw"
server_key: "4a862d767805ee0f3002287f433c61e8"
server_key_iv: "a9630f2d6117294ade023194c1e01fdd"
server_key_version: "encryptionkey@0"
I20260808 05:07:29.831127 9968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:29.846263 9968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:29.848659 9968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:29.848838 9968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:29.853260 9968 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38637
I20260808 05:07:29.853292 10064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38637 every 8 connection(s)
I20260808 05:07:29.853672 9968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:29.854595 10066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:29.857015 10066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791: Bootstrap starting.
I20260808 05:07:29.857635 10066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:29.857942 10066 log.cc:824] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:29.858675 10066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791: No bootstrap required, opened a new log
I20260808 05:07:29.859248 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 9968
I20260808 05:07:29.859391 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:29.859599 11547 external_mini_cluster.cc:1428] Setting key 60ac075c522fc4251a28025569164bc2
I20260808 05:07:29.860874 10066 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d8ad769d93b4076aaab0750856a9791" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38637 } }
I20260808 05:07:29.861047 10066 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:29.861166 10066 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d8ad769d93b4076aaab0750856a9791, State: Initialized, Role: FOLLOWER
I20260808 05:07:29.861322 10066 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d8ad769d93b4076aaab0750856a9791" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38637 } }
I20260808 05:07:29.861429 10066 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:29.861478 10066 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:29.861536 10066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:29.862416 10066 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d8ad769d93b4076aaab0750856a9791" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38637 } }
I20260808 05:07:29.862571 10066 leader_election.cc:302] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0d8ad769d93b4076aaab0750856a9791; no voters:
I20260808 05:07:29.862751 10066 leader_election.cc:288] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:29.862797 10073 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:29.862937 10073 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [term 1 LEADER]: Becoming Leader. State: Replica: 0d8ad769d93b4076aaab0750856a9791, State: Running, Role: LEADER
I20260808 05:07:29.863014 10066 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:29.863085 10073 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d8ad769d93b4076aaab0750856a9791" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38637 } }
I20260808 05:07:29.863478 10073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0d8ad769d93b4076aaab0750856a9791. Latest consensus state: current_term: 1 leader_uuid: "0d8ad769d93b4076aaab0750856a9791" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d8ad769d93b4076aaab0750856a9791" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38637 } } }
I20260808 05:07:29.863687 10073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:29.863627 10078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0d8ad769d93b4076aaab0750856a9791" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0d8ad769d93b4076aaab0750856a9791" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38637 } } }
I20260808 05:07:29.863921 10078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:29.864343 10089 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:29.864908 10089 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:29.866542 10089 catalog_manager.cc:1347] Generated new cluster ID: 4aadc76262c444be9de0104b17dc26db
I20260808 05:07:29.866611 10089 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:07:29 dist-test-slave-7kzw krb5kdc[9950](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165649, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:07:29.872119 10072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:29.860137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:60453 (local address 127.0.0.1:38637)
0808 05:07:29.860329 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:29.860337 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:29.860367 (+ 30us) server_negotiation.cc:407] Connection header received
0808 05:07:29.860847 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:29.860853 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:29.860902 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:29.861014 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:29.861879 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:29.863013 (+ 1134us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:29.864121 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:29.864922 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:29.865035 (+ 113us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:29.867957 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:29.867961 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:29.867961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:29.867974 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:29.870019 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:29.870547 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:29.870550 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:29.870551 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:29.870696 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:29.870955 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:29.870956 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:29.870956 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:29.871270 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:29.871443 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:29.871560 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 05:07:29.871677 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":106,"threads_started":1}
I20260808 05:07:29.872529 10089 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:29.873189 10089 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:29.873235 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:29.877143 10089 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0d8ad769d93b4076aaab0750856a9791: Generated new TSK 0
I20260808 05:07:29.877326 10089 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:29.884167 10072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:29.877018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:41225 (local address 127.0.0.1:38637)
0808 05:07:29.877065 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:29.877067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:29.877398 (+ 331us) server_negotiation.cc:407] Connection header received
0808 05:07:29.877507 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:29.877508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:29.877520 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:29.877579 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:29.878216 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:29.878826 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:29.879890 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:29.880100 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:29.880162 (+ 62us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:29.881567 (+ 1405us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:29.881568 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:29.881569 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:29.881575 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:29.883018 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:29.883431 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:29.883431 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:29.883432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:29.883486 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:29.883721 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:29.883721 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:29.883722 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:29.883828 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:29.883908 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:29.884057 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 05:07:29.884106 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:07:29.886456 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 9968
W20260808 05:07:29.904160 9947 connection.cc:535] client connection to 127.0.0.1:38637 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38637): Connection reset by peer (error 104)
2026-08-08T05:07:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1561 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:29 dist-test-slave-7kzw krb5kdc[10113](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:29 dist-test-slave-7kzw krb5kdc[10113](info): set up 2 sockets
Aug 08 05:07:29 dist-test-slave-7kzw krb5kdc[10113](info): commencing operation
krb5kdc: starting...
W20260808 05:07:31.137104 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.218s user 0.007s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:31 dist-test-slave-7kzw krb5kdc[10113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165651, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:31.269484 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37269
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43905
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:31.354642 10135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:31.354883 10135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:31.354921 10135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:31.356060 10135 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:31.356134 10135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:31.356158 10135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:31.356180 10135 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:31.356208 10135 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:31.357722 10135 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43905
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37269
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:31.357998 10135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:31.358233 10135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:31.363202 10140 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:31.363196 10147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:31.363199 10142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:31.363888 10135 server_base.cc:1034] running on GCE node
I20260808 05:07:31.364127 10135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:31.364426 10135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:31.365589 10135 hybrid_clock.cc:648] HybridClock initialized: now 1786165651365574 us; error 30 us; skew 500 ppm
Aug 08 05:07:31 dist-test-slave-7kzw krb5kdc[10113](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165651, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:31.368296 10135 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:31.368734 10135 webserver.cc:460] Webserver started at http://127.0.0.1:34075/ using document root <none> and password file <none>
I20260808 05:07:31.368994 10135 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:31.369064 10135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:31.369225 10135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:31.370325 10135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "c20549041a144b25ae81752b97b512c5"
format_stamp: "Formatted at 2026-08-08 05:07:31 on dist-test-slave-7kzw"
server_key: "5e0e94ba143eeb1fcb9eb5eb484e19e3"
server_key_iv: "3813685b156f387c895405dd11a1d387"
server_key_version: "encryptionkey@0"
I20260808 05:07:31.370708 10135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "c20549041a144b25ae81752b97b512c5"
format_stamp: "Formatted at 2026-08-08 05:07:31 on dist-test-slave-7kzw"
server_key: "5e0e94ba143eeb1fcb9eb5eb484e19e3"
server_key_iv: "3813685b156f387c895405dd11a1d387"
server_key_version: "encryptionkey@0"
I20260808 05:07:31.372192 10135 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:31.373133 10159 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:31.373337 10135 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:31.373456 10135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "c20549041a144b25ae81752b97b512c5"
format_stamp: "Formatted at 2026-08-08 05:07:31 on dist-test-slave-7kzw"
server_key: "5e0e94ba143eeb1fcb9eb5eb484e19e3"
server_key_iv: "3813685b156f387c895405dd11a1d387"
server_key_version: "encryptionkey@0"
I20260808 05:07:31.373538 10135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:31.389994 10135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:31.392143 10135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:31.392320 10135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:31.396734 10135 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37269
I20260808 05:07:31.396777 10225 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37269 every 8 connection(s)
I20260808 05:07:31.397173 10135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:31.398108 10226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:31.400477 10226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5: Bootstrap starting.
I20260808 05:07:31.401085 10226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:31.401377 10226 log.cc:824] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:31.402158 10226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5: No bootstrap required, opened a new log
I20260808 05:07:31.403846 10226 raft_consensus.cc:348] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20549041a144b25ae81752b97b512c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37269 } }
I20260808 05:07:31.403990 10226 raft_consensus.cc:374] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:31.404014 10226 raft_consensus.cc:729] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c20549041a144b25ae81752b97b512c5, State: Initialized, Role: FOLLOWER
I20260808 05:07:31.404165 10226 consensus_queue.cc:260] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20549041a144b25ae81752b97b512c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37269 } }
I20260808 05:07:31.404254 10226 raft_consensus.cc:388] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:31.404278 10226 raft_consensus.cc:482] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:31.404326 10226 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:31.404884 10226 raft_consensus.cc:504] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20549041a144b25ae81752b97b512c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37269 } }
I20260808 05:07:31.404978 10226 leader_election.cc:302] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c20549041a144b25ae81752b97b512c5; no voters:
I20260808 05:07:31.405124 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 10135
I20260808 05:07:31.405193 10226 leader_election.cc:288] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:31.405215 10230 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:31.405273 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:31.405388 10230 raft_consensus.cc:686] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [term 1 LEADER]: Becoming Leader. State: Replica: c20549041a144b25ae81752b97b512c5, State: Running, Role: LEADER
I20260808 05:07:31.405500 11547 external_mini_cluster.cc:1428] Setting key 7424be903e14c135e1b49fc1626433c9
I20260808 05:07:31.405530 10226 sys_catalog.cc:564] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:31.405530 10230 consensus_queue.cc:237] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20549041a144b25ae81752b97b512c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37269 } }
I20260808 05:07:31.406117 10231 sys_catalog.cc:455] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c20549041a144b25ae81752b97b512c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20549041a144b25ae81752b97b512c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37269 } } }
I20260808 05:07:31.406368 10231 sys_catalog.cc:458] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:31.406292 10233 sys_catalog.cc:455] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c20549041a144b25ae81752b97b512c5. Latest consensus state: current_term: 1 leader_uuid: "c20549041a144b25ae81752b97b512c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c20549041a144b25ae81752b97b512c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37269 } } }
I20260808 05:07:31.406674 10233 sys_catalog.cc:458] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:31.406908 10252 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:31.407451 10252 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:31.409240 10252 catalog_manager.cc:1347] Generated new cluster ID: 9cd10fa00ed34243b252e5918d6b3f2b
I20260808 05:07:31.409297 10252 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:31.412451 10248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:31.406190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:40379 (local address 127.0.0.1:37269)
0808 05:07:31.406403 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:31.406412 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:31.406960 (+ 548us) server_negotiation.cc:407] Connection header received
0808 05:07:31.407179 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:31.407188 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:31.407294 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:31.407451 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:31.407673 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:31.408970 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:31.410094 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:31.410734 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:31.410824 (+ 90us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:31.411696 (+ 872us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:31.411700 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:31.411701 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:31.411929 (+ 228us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:31.411966 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:31.411980 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:31.412050 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:31.412219 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 05:07:31.412246 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":102,"threads_started":1}
I20260808 05:07:31.413925 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:31.417368 10252 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:31.417891 10252 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:31.419241 10248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:31.415543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:48747 (local address 127.0.0.1:37269)
0808 05:07:31.415584 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:31.415586 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:31.415698 (+ 112us) server_negotiation.cc:407] Connection header received
0808 05:07:31.415751 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:31.415752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:31.415763 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:31.415819 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:31.415953 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:31.416666 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:31.417881 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:31.418151 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:31.418221 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:31.418950 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:31.418951 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:31.418952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:31.418956 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:31.418971 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:31.418975 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:31.419024 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:31.419150 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 05:07:31.419163 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:07:31.420795 10252 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c20549041a144b25ae81752b97b512c5: Generated new TSK 0
I20260808 05:07:31.420956 10252 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:31.427017 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 10135
W20260808 05:07:31.441756 10109 connection.cc:535] client connection to 127.0.0.1:37269 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37269): Connection reset by peer (error 104)
2026-08-08T05:07:31Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1537 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:31 dist-test-slave-7kzw krb5kdc[10275](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:31 dist-test-slave-7kzw krb5kdc[10275](info): set up 2 sockets
Aug 08 05:07:31 dist-test-slave-7kzw krb5kdc[10275](info): commencing operation
krb5kdc: starting...
W20260808 05:07:32.677984 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.222s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:32 dist-test-slave-7kzw krb5kdc[10275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165652, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:07:32.805377 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46269
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45129
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46269
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:32.888435 10292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:32.888649 10292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:32.888674 10292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:32.889828 10292 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:32.889874 10292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:32.889889 10292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:32.889901 10292 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:32.889914 10292 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:32.891425 10292 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45129
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46269
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46269
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:32.891664 10292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:32.891904 10292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:32.896903 10304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:32.896911 10305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:32.897127 10292 server_base.cc:1034] running on GCE node
W20260808 05:07:32.897008 10308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:32.897436 10292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:32.897759 10292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:32.898931 10292 hybrid_clock.cc:648] HybridClock initialized: now 1786165652898916 us; error 35 us; skew 500 ppm
Aug 08 05:07:32 dist-test-slave-7kzw krb5kdc[10275](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165652, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:32.901636 10292 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:07:32.902114 10292 webserver.cc:460] Webserver started at http://127.0.0.1:42549/ using document root <none> and password file <none>
I20260808 05:07:32.902361 10292 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:32.902428 10292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:32.902611 10292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:32.903699 10292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "86a27886d8f643ac8516fb38ebbb60c5"
format_stamp: "Formatted at 2026-08-08 05:07:32 on dist-test-slave-7kzw"
server_key: "da0a3346c583d4959a716133d51366d9"
server_key_iv: "6724b2dbb525ea79ec927fc2b373eb19"
server_key_version: "encryptionkey@0"
I20260808 05:07:32.904076 10292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "86a27886d8f643ac8516fb38ebbb60c5"
format_stamp: "Formatted at 2026-08-08 05:07:32 on dist-test-slave-7kzw"
server_key: "da0a3346c583d4959a716133d51366d9"
server_key_iv: "6724b2dbb525ea79ec927fc2b373eb19"
server_key_version: "encryptionkey@0"
I20260808 05:07:32.905462 10292 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:32.906301 10319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:32.906549 10292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:32.906661 10292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "86a27886d8f643ac8516fb38ebbb60c5"
format_stamp: "Formatted at 2026-08-08 05:07:32 on dist-test-slave-7kzw"
server_key: "da0a3346c583d4959a716133d51366d9"
server_key_iv: "6724b2dbb525ea79ec927fc2b373eb19"
server_key_version: "encryptionkey@0"
I20260808 05:07:32.906745 10292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:32.910068 10292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:32.912503 10292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:32.912659 10292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:32.916848 10292 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46269
I20260808 05:07:32.916894 10390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46269 every 8 connection(s)
I20260808 05:07:32.917236 10292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:32.918241 10391 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:32.920540 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 10292
I20260808 05:07:32.920648 10391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5: Bootstrap starting.
I20260808 05:07:32.920683 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:32.920877 11547 external_mini_cluster.cc:1428] Setting key f020196cefa9febfb05b4b19ff394cf3
I20260808 05:07:32.921406 10391 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:32.921752 10391 log.cc:824] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:32.922555 10391 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5: No bootstrap required, opened a new log
I20260808 05:07:32.923452 10394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:32.921385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:52827 (local address 127.0.0.1:46269)
0808 05:07:32.921619 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:32.921627 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:32.921654 (+ 27us) server_negotiation.cc:407] Connection header received
0808 05:07:32.922229 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:32.922239 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:32.922281 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:32.922399 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:32.923011 (+ 612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:32.923014 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:32.923014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:32.923017 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:32.923049 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:32.923059 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:32.923124 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:32.923190 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 05:07:32.923243 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":89,"threads_started":1}
I20260808 05:07:32.924381 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:32.925206 10391 raft_consensus.cc:348] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a27886d8f643ac8516fb38ebbb60c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46269 } }
I20260808 05:07:32.925397 10391 raft_consensus.cc:374] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:32.925431 10391 raft_consensus.cc:729] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 86a27886d8f643ac8516fb38ebbb60c5, State: Initialized, Role: FOLLOWER
I20260808 05:07:32.925560 10391 consensus_queue.cc:260] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a27886d8f643ac8516fb38ebbb60c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46269 } }
I20260808 05:07:32.925678 10391 raft_consensus.cc:388] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:32.925733 10391 raft_consensus.cc:482] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:32.925786 10391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:32.926651 10391 raft_consensus.cc:504] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a27886d8f643ac8516fb38ebbb60c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46269 } }
I20260808 05:07:32.926774 10391 leader_election.cc:302] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 86a27886d8f643ac8516fb38ebbb60c5; no voters:
I20260808 05:07:32.926951 10391 leader_election.cc:288] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:32.926991 10406 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:32.927181 10406 raft_consensus.cc:686] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [term 1 LEADER]: Becoming Leader. State: Replica: 86a27886d8f643ac8516fb38ebbb60c5, State: Running, Role: LEADER
I20260808 05:07:32.927240 10391 sys_catalog.cc:564] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:32.927397 10406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a27886d8f643ac8516fb38ebbb60c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46269 } }
I20260808 05:07:32.927476 10394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:32.926148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.136:34007 (local address 127.0.0.1:46269)
0808 05:07:32.926203 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:32.926205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:32.926355 (+ 150us) server_negotiation.cc:407] Connection header received
0808 05:07:32.926402 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:32.926402 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:32.926407 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:32.926456 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:32.927196 (+ 740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:32.927198 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:32.927198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:32.927203 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:32.927218 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:32.927222 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:32.927263 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:32.927381 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 05:07:32.927394 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:07:32.928031 10407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "86a27886d8f643ac8516fb38ebbb60c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a27886d8f643ac8516fb38ebbb60c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46269 } } }
I20260808 05:07:32.928236 10407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:32.928810 10408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 86a27886d8f643ac8516fb38ebbb60c5. Latest consensus state: current_term: 1 leader_uuid: "86a27886d8f643ac8516fb38ebbb60c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "86a27886d8f643ac8516fb38ebbb60c5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46269 } } }
I20260808 05:07:32.928895 10408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5 [sys.catalog]: This master's current role is: LEADER
W20260808 05:07:32.929376 10430 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:07:32.929431 10430 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:32.929490 10418 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:32.929711 10418 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:32.931319 10418 catalog_manager.cc:1347] Generated new cluster ID: 27607dd9f56a47ab8376fb9135fee92c
I20260808 05:07:32.931382 10418 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:32.949566 10418 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:32.949786 10418 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:32.957372 10418 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 86a27886d8f643ac8516fb38ebbb60c5: Generated new TSK 0
I20260808 05:07:32.957598 10418 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:32.961853 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 10292
2026-08-08T05:07:32Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1533 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:33 dist-test-slave-7kzw krb5kdc[10435](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:33 dist-test-slave-7kzw krb5kdc[10435](info): set up 2 sockets
Aug 08 05:07:33 dist-test-slave-7kzw krb5kdc[10435](info): commencing operation
krb5kdc: starting...
W20260808 05:07:34.265362 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.276s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:34 dist-test-slave-7kzw krb5kdc[10435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:34.393882 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37407
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42563
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:37407
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:34.476462 10454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:34.476728 10454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:34.476768 10454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:34.477937 10454 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:34.478010 10454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:34.478035 10454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:34.478065 10454 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:34.478091 10454 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:34.479583 10454 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42563
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:37407
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:37407
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10454
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:34.479863 10454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:34.480104 10454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:34.485250 10463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:34.485270 10462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:34.485258 10465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:34.485447 10454 server_base.cc:1034] running on GCE node
I20260808 05:07:34.485716 10454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:34.486066 10454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:34.487216 10454 hybrid_clock.cc:648] HybridClock initialized: now 1786165654487206 us; error 33 us; skew 500 ppm
Aug 08 05:07:34 dist-test-slave-7kzw krb5kdc[10435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165654, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:34.489913 10454 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:34.490408 10454 webserver.cc:460] Webserver started at http://127.11.70.254:36993/ using document root <none> and password file <none>
I20260808 05:07:34.490656 10454 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:34.490731 10454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:34.490885 10454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:34.491953 10454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "b974c2544e3f49518713fb0ab64b9677"
format_stamp: "Formatted at 2026-08-08 05:07:34 on dist-test-slave-7kzw"
server_key: "01ce47bb3b1a8c4fa95c54446c3f6fa4"
server_key_iv: "5657044aef1ccdf68937e45eb984d33f"
server_key_version: "encryptionkey@0"
I20260808 05:07:34.492338 10454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "b974c2544e3f49518713fb0ab64b9677"
format_stamp: "Formatted at 2026-08-08 05:07:34 on dist-test-slave-7kzw"
server_key: "01ce47bb3b1a8c4fa95c54446c3f6fa4"
server_key_iv: "5657044aef1ccdf68937e45eb984d33f"
server_key_version: "encryptionkey@0"
I20260808 05:07:34.493701 10454 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:34.494414 10472 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:34.494601 10454 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:07:34.494719 10454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "b974c2544e3f49518713fb0ab64b9677"
format_stamp: "Formatted at 2026-08-08 05:07:34 on dist-test-slave-7kzw"
server_key: "01ce47bb3b1a8c4fa95c54446c3f6fa4"
server_key_iv: "5657044aef1ccdf68937e45eb984d33f"
server_key_version: "encryptionkey@0"
I20260808 05:07:34.494794 10454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:34.503908 10454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:34.506387 10454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:34.506594 10454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:34.510905 10454 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:37407
I20260808 05:07:34.510936 10560 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:37407 every 8 connection(s)
I20260808 05:07:34.511310 10454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:34.512176 10561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:34.514451 10561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677: Bootstrap starting.
I20260808 05:07:34.515108 10561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:34.515420 10561 log.cc:824] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:34.516117 10561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677: No bootstrap required, opened a new log
I20260808 05:07:34.517726 10561 raft_consensus.cc:348] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b974c2544e3f49518713fb0ab64b9677" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37407 } }
I20260808 05:07:34.517865 10561 raft_consensus.cc:374] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:34.517889 10561 raft_consensus.cc:729] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b974c2544e3f49518713fb0ab64b9677, State: Initialized, Role: FOLLOWER
I20260808 05:07:34.518071 10561 consensus_queue.cc:260] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b974c2544e3f49518713fb0ab64b9677" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37407 } }
I20260808 05:07:34.518136 10561 raft_consensus.cc:388] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:34.518188 10561 raft_consensus.cc:482] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:34.518240 10561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:34.519176 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 10454
I20260808 05:07:34.519317 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:34.519325 10561 raft_consensus.cc:504] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b974c2544e3f49518713fb0ab64b9677" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37407 } }
I20260808 05:07:34.519443 10561 leader_election.cc:302] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b974c2544e3f49518713fb0ab64b9677; no voters:
I20260808 05:07:34.519527 11547 external_mini_cluster.cc:1428] Setting key 2be46d911130a66583767e6e4615458e
I20260808 05:07:34.519626 10561 leader_election.cc:288] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:34.519654 10564 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:34.519842 10564 raft_consensus.cc:686] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [term 1 LEADER]: Becoming Leader. State: Replica: b974c2544e3f49518713fb0ab64b9677, State: Running, Role: LEADER
I20260808 05:07:34.519881 10561 sys_catalog.cc:564] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:34.519977 10564 consensus_queue.cc:237] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b974c2544e3f49518713fb0ab64b9677" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37407 } }
I20260808 05:07:34.520357 10564 sys_catalog.cc:455] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b974c2544e3f49518713fb0ab64b9677. Latest consensus state: current_term: 1 leader_uuid: "b974c2544e3f49518713fb0ab64b9677" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b974c2544e3f49518713fb0ab64b9677" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37407 } } }
I20260808 05:07:34.520411 10566 sys_catalog.cc:455] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b974c2544e3f49518713fb0ab64b9677" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b974c2544e3f49518713fb0ab64b9677" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 37407 } } }
I20260808 05:07:34.520480 10564 sys_catalog.cc:458] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:34.520565 10566 sys_catalog.cc:458] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:34.520860 10576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:34.521601 10576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:34.523367 10576 catalog_manager.cc:1347] Generated new cluster ID: e25aea3285dd41628cf277355f90b84a
I20260808 05:07:34.523437 10576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:07:34 dist-test-slave-7kzw krb5kdc[10435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165654, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:34.530411 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:34.520257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42031 (local address 127.11.70.254:37407)
0808 05:07:34.520493 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:34.520502 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:34.520539 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:07:34.520842 (+ 303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:34.520851 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:34.520914 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:34.521047 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:34.522107 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:34.523364 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:34.524189 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:34.524641 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:34.524706 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:34.527229 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:34.527235 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:34.527235 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:34.527263 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:34.528846 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:34.529275 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:34.529277 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:34.529278 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:34.529374 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:34.529617 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:34.529618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:34.529619 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:34.529860 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:34.530060 (+ 200us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:34.530146 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 05:07:34.530252 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":60,"threads_started":1}
I20260808 05:07:34.531410 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:34.540927 10571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:34.532803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59493 (local address 127.11.70.254:37407)
0808 05:07:34.532841 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:34.532843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:34.534659 (+ 1816us) server_negotiation.cc:407] Connection header received
0808 05:07:34.534754 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:34.534755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:34.534764 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:34.534821 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:34.535354 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:34.535856 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:34.536566 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:34.536808 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:34.536886 (+ 78us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:34.538129 (+ 1243us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:34.538131 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:34.538131 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:34.538139 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:34.539614 (+ 1475us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:34.540089 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:34.540090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:34.540090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:34.540151 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:34.540390 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:34.540392 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:34.540392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:34.540508 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:34.540624 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:34.540750 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 05:07:34.540816 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:07:34.545288 10576 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:34.546241 10576 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:34.566324 10576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b974c2544e3f49518713fb0ab64b9677: Generated new TSK 0
I20260808 05:07:34.566572 10576 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:34.571259 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 10454
W20260808 05:07:34.582967 10433 connection.cc:535] client connection to 127.11.70.254:37407 recv error: Network error: failed to read from TLS socket (remote: 127.11.70.254:37407): Connection reset by peer (error 104)
2026-08-08T05:07:34Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1607 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:34 dist-test-slave-7kzw krb5kdc[10599](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:34 dist-test-slave-7kzw krb5kdc[10599](info): set up 2 sockets
Aug 08 05:07:34 dist-test-slave-7kzw krb5kdc[10599](info): commencing operation
krb5kdc: starting...
W20260808 05:07:35.912549 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.316s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:35 dist-test-slave-7kzw krb5kdc[10599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165655, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:36.043407 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:38453
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:39877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:38453
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:36.129422 10613 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:36.129637 10613 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:36.129663 10613 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:36.130852 10613 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:36.130896 10613 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:36.130911 10613 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:36.130923 10613 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:36.130936 10613 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:36.132428 10613 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:39877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:38453
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:38453
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10613
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:36.132696 10613 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:36.132938 10613 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:36.137933 10623 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:36.137965 10626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:36.137929 10620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:36.138198 10613 server_base.cc:1034] running on GCE node
I20260808 05:07:36.138513 10613 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:36.138883 10613 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:36.140079 10613 hybrid_clock.cc:648] HybridClock initialized: now 1786165656140053 us; error 36 us; skew 500 ppm
Aug 08 05:07:36 dist-test-slave-7kzw krb5kdc[10599](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165656, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:36.146095 10613 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:36.146552 10613 webserver.cc:460] Webserver started at http://127.11.70.254:38863/ using document root <none> and password file <none>
I20260808 05:07:36.146776 10613 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:36.146818 10613 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:36.146906 10613 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:36.147925 10613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "cea355055b7c4a2d99b0bf1a4ed316ab"
format_stamp: "Formatted at 2026-08-08 05:07:36 on dist-test-slave-7kzw"
server_key: "96ccf16198c8a88b065ffb1f478a8e59"
server_key_iv: "ea868d6844d6ecc84c1a3ca484767c46"
server_key_version: "encryptionkey@0"
I20260808 05:07:36.148243 10613 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "cea355055b7c4a2d99b0bf1a4ed316ab"
format_stamp: "Formatted at 2026-08-08 05:07:36 on dist-test-slave-7kzw"
server_key: "96ccf16198c8a88b065ffb1f478a8e59"
server_key_iv: "ea868d6844d6ecc84c1a3ca484767c46"
server_key_version: "encryptionkey@0"
I20260808 05:07:36.149634 10613 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:36.150360 10635 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:36.150547 10613 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:36.150641 10613 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "cea355055b7c4a2d99b0bf1a4ed316ab"
format_stamp: "Formatted at 2026-08-08 05:07:36 on dist-test-slave-7kzw"
server_key: "96ccf16198c8a88b065ffb1f478a8e59"
server_key_iv: "ea868d6844d6ecc84c1a3ca484767c46"
server_key_version: "encryptionkey@0"
I20260808 05:07:36.150701 10613 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:36.173635 10613 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:36.176172 10613 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:36.176296 10613 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:36.180438 10613 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:38453
I20260808 05:07:36.180501 10709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:38453 every 8 connection(s)
I20260808 05:07:36.180836 10613 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:36.181783 10710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:36.184175 10710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab: Bootstrap starting.
I20260808 05:07:36.184779 10710 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:36.185079 10710 log.cc:824] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:36.185894 10710 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab: No bootstrap required, opened a new log
I20260808 05:07:36.187629 10710 raft_consensus.cc:348] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea355055b7c4a2d99b0bf1a4ed316ab" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38453 } }
I20260808 05:07:36.187803 10710 raft_consensus.cc:374] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:36.187849 10710 raft_consensus.cc:729] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cea355055b7c4a2d99b0bf1a4ed316ab, State: Initialized, Role: FOLLOWER
I20260808 05:07:36.188024 10710 consensus_queue.cc:260] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea355055b7c4a2d99b0bf1a4ed316ab" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38453 } }
I20260808 05:07:36.188112 10710 raft_consensus.cc:388] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:36.188159 10710 raft_consensus.cc:482] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:36.188215 10710 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:36.189109 10710 raft_consensus.cc:504] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea355055b7c4a2d99b0bf1a4ed316ab" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38453 } }
I20260808 05:07:36.189239 10710 leader_election.cc:302] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cea355055b7c4a2d99b0bf1a4ed316ab; no voters:
I20260808 05:07:36.189426 10710 leader_election.cc:288] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:36.189458 10714 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:36.189644 10714 raft_consensus.cc:686] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [term 1 LEADER]: Becoming Leader. State: Replica: cea355055b7c4a2d99b0bf1a4ed316ab, State: Running, Role: LEADER
I20260808 05:07:36.189675 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 10613
I20260808 05:07:36.189802 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:36.189780 10714 consensus_queue.cc:237] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea355055b7c4a2d99b0bf1a4ed316ab" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38453 } }
I20260808 05:07:36.189811 10710 sys_catalog.cc:564] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:36.190017 11547 external_mini_cluster.cc:1428] Setting key bce6db4bb2e282a12c75d1356da0a473
I20260808 05:07:36.190116 10715 sys_catalog.cc:455] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cea355055b7c4a2d99b0bf1a4ed316ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea355055b7c4a2d99b0bf1a4ed316ab" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38453 } } }
I20260808 05:07:36.190214 10715 sys_catalog.cc:458] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:36.190500 10718 sys_catalog.cc:455] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader cea355055b7c4a2d99b0bf1a4ed316ab. Latest consensus state: current_term: 1 leader_uuid: "cea355055b7c4a2d99b0bf1a4ed316ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cea355055b7c4a2d99b0bf1a4ed316ab" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 38453 } } }
I20260808 05:07:36.190898 10718 sys_catalog.cc:458] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:36.191056 10721 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:36.191659 10721 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:36.193135 10721 catalog_manager.cc:1347] Generated new cluster ID: c96a308d623d4bb4a20451ff29833a8d
I20260808 05:07:36.193189 10721 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:36.196805 10733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:36.190764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44975 (local address 127.11.70.254:38453)
0808 05:07:36.190980 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:36.190990 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:36.191024 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:07:36.191171 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:36.191179 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:36.191253 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:36.191698 (+ 445us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:36.191795 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:36.193274 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:36.194375 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:36.195049 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:36.195183 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:36.195940 (+ 757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:36.195944 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:36.195944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:36.196189 (+ 245us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:36.196229 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:36.196247 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:36.196331 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:36.196425 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 05:07:36.196582 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":87,"threads_started":1}
I20260808 05:07:36.197810 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:36.202898 10733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:36.199493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51125 (local address 127.11.70.254:38453)
0808 05:07:36.199527 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:36.199529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:36.199587 (+ 58us) server_negotiation.cc:407] Connection header received
0808 05:07:36.199647 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:36.199648 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:36.199671 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:36.199736 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:36.199870 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:36.200616 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:36.201577 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:36.201885 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:36.201959 (+ 74us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:36.202645 (+ 686us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:36.202646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:36.202646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:36.202651 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:36.202667 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:36.202671 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:36.202738 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:36.202813 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 05:07:36.202825 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:07:36.206158 10721 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:36.206773 10721 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:36.209978 10721 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cea355055b7c4a2d99b0bf1a4ed316ab: Generated new TSK 0
I20260808 05:07:36.210186 10721 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:36.213372 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 10613
W20260808 05:07:36.226037 10596 connection.cc:535] client connection to 127.11.70.254:38453 recv error: Network error: failed to read from TLS socket (remote: 127.11.70.254:38453): Connection reset by peer (error 104)
2026-08-08T05:07:36Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1643 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:36 dist-test-slave-7kzw krb5kdc[10753](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:36 dist-test-slave-7kzw krb5kdc[10753](info): set up 2 sockets
Aug 08 05:07:36 dist-test-slave-7kzw krb5kdc[10753](info): commencing operation
krb5kdc: starting...
W20260808 05:07:37.439400 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.199s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:37 dist-test-slave-7kzw krb5kdc[10753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165657, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:37.567971 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:42765
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:35739
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:42765
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:37.652674 10772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:37.652905 10772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:37.652930 10772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:37.654093 10772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:37.654140 10772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:37.654155 10772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:37.654168 10772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:37.654181 10772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:37.655754 10772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:35739
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:42765
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:42765
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:37.656026 10772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:37.656275 10772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:37.661568 10782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:37.661638 10772 server_base.cc:1034] running on GCE node
W20260808 05:07:37.661767 10780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:37.661911 10779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:37.662257 10772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:37.662618 10772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:37.663769 10772 hybrid_clock.cc:648] HybridClock initialized: now 1786165657663750 us; error 33 us; skew 500 ppm
Aug 08 05:07:37 dist-test-slave-7kzw krb5kdc[10753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165657, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:37.667346 10772 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:37.667999 10772 webserver.cc:460] Webserver started at http://127.11.70.254:35775/ using document root <none> and password file <none>
I20260808 05:07:37.668210 10772 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:37.668253 10772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:37.668346 10772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:37.669390 10772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6"
format_stamp: "Formatted at 2026-08-08 05:07:37 on dist-test-slave-7kzw"
server_key: "ae2a9b45db6a9c825cf743baad2cec32"
server_key_iv: "ca3340d4979326feda8da0d3cb411055"
server_key_version: "encryptionkey@0"
I20260808 05:07:37.669718 10772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6"
format_stamp: "Formatted at 2026-08-08 05:07:37 on dist-test-slave-7kzw"
server_key: "ae2a9b45db6a9c825cf743baad2cec32"
server_key_iv: "ca3340d4979326feda8da0d3cb411055"
server_key_version: "encryptionkey@0"
I20260808 05:07:37.671309 10772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:37.672363 10791 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:37.672551 10772 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:37.672636 10772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6"
format_stamp: "Formatted at 2026-08-08 05:07:37 on dist-test-slave-7kzw"
server_key: "ae2a9b45db6a9c825cf743baad2cec32"
server_key_iv: "ca3340d4979326feda8da0d3cb411055"
server_key_version: "encryptionkey@0"
I20260808 05:07:37.672731 10772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:37.676049 10772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:37.678375 10772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:37.678552 10772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:37.682523 10772 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:42765
I20260808 05:07:37.682662 10867 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:42765 every 8 connection(s)
I20260808 05:07:37.682966 10772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:37.683586 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 10772
I20260808 05:07:37.683750 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:37.684000 11547 external_mini_cluster.cc:1428] Setting key 8400b16ff140b6a876dd69908706c618
I20260808 05:07:37.684415 10868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:37.687177 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:37.684597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41425 (local address 127.11.70.254:42765)
0808 05:07:37.684838 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:37.684846 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:37.684875 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:07:37.685666 (+ 791us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:37.685675 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:37.685703 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:37.685835 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:37.686607 (+ 772us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:37.686615 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:37.686616 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:37.686621 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:37.686694 (+ 73us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:37.686711 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:37.686805 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:37.686900 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 05:07:37.686965 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":176,"thread_start_us":92,"threads_started":1}
I20260808 05:07:37.688282 10868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6: Bootstrap starting.
I20260808 05:07:37.688344 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:37.688912 10868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:37.689198 10868 log.cc:824] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:37.690064 10868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6: No bootstrap required, opened a new log
I20260808 05:07:37.691041 10872 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:37.689840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48591 (local address 127.11.70.254:42765)
0808 05:07:37.689897 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:37.689899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:37.690069 (+ 170us) server_negotiation.cc:407] Connection header received
0808 05:07:37.690137 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:37.690138 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:37.690142 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:37.690206 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:37.690813 (+ 607us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:37.690814 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:37.690814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:37.690818 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:37.690831 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:37.690835 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:37.690881 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:37.690934 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 05:07:37.690944 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:07:37.692498 10868 raft_consensus.cc:348] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42765 } }
I20260808 05:07:37.692668 10868 raft_consensus.cc:374] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:37.692719 10868 raft_consensus.cc:729] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2416c9ca8de46ebb3795a9d07aaa9c6, State: Initialized, Role: FOLLOWER
I20260808 05:07:37.692843 10868 consensus_queue.cc:260] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42765 } }
I20260808 05:07:37.692939 10868 raft_consensus.cc:388] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:37.692983 10868 raft_consensus.cc:482] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:37.693034 10868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:37.693585 10868 raft_consensus.cc:504] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42765 } }
I20260808 05:07:37.693709 10868 leader_election.cc:302] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e2416c9ca8de46ebb3795a9d07aaa9c6; no voters:
I20260808 05:07:37.693907 10868 leader_election.cc:288] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:37.693948 10881 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:37.694144 10881 raft_consensus.cc:686] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [term 1 LEADER]: Becoming Leader. State: Replica: e2416c9ca8de46ebb3795a9d07aaa9c6, State: Running, Role: LEADER
I20260808 05:07:37.694181 10868 sys_catalog.cc:564] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:37.694239 10881 consensus_queue.cc:237] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42765 } }
I20260808 05:07:37.694674 10883 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42765 } } }
I20260808 05:07:37.694684 10884 sys_catalog.cc:455] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e2416c9ca8de46ebb3795a9d07aaa9c6. Latest consensus state: current_term: 1 leader_uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e2416c9ca8de46ebb3795a9d07aaa9c6" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 42765 } } }
I20260808 05:07:37.694818 10884 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:37.694806 10883 sys_catalog.cc:458] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:37.695092 10898 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:37.695611 10898 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:37.697315 10898 catalog_manager.cc:1347] Generated new cluster ID: ee10a09462e646e9a86ce8bed79f52b0
I20260808 05:07:37.697374 10898 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:37.721112 10898 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:37.721324 10898 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:37.729769 10898 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e2416c9ca8de46ebb3795a9d07aaa9c6: Generated new TSK 0
I20260808 05:07:37.730008 10898 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:37.740927 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 10772
2026-08-08T05:07:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1527 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:37 dist-test-slave-7kzw krb5kdc[10916](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:37 dist-test-slave-7kzw krb5kdc[10916](info): set up 2 sockets
Aug 08 05:07:37 dist-test-slave-7kzw krb5kdc[10916](info): commencing operation
krb5kdc: starting...
W20260808 05:07:39.051215 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.001s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:39 dist-test-slave-7kzw krb5kdc[10916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:39.181578 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34063
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:35661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:34063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:39.265275 10932 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:39.265530 10932 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:39.265573 10932 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:39.266806 10932 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:39.266871 10932 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:39.266896 10932 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:39.266925 10932 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:39.266955 10932 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:39.268474 10932 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:35661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:34063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10932
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:39.268770 10932 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:39.269016 10932 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:39.274300 10939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:39.274310 10940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:39.274333 10932 server_base.cc:1034] running on GCE node
W20260808 05:07:39.274310 10942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:39.274899 10932 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:39.275219 10932 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:39.276397 10932 hybrid_clock.cc:648] HybridClock initialized: now 1786165659276382 us; error 47 us; skew 500 ppm
Aug 08 05:07:39 dist-test-slave-7kzw krb5kdc[10916](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165659, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:39.279382 10932 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:39.279865 10932 webserver.cc:460] Webserver started at http://127.11.70.254:36187/ using document root <none> and password file <none>
I20260808 05:07:39.280062 10932 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:39.280107 10932 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:39.280203 10932 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:39.281241 10932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "52b87323f7534363844547b1a37f5cf7"
format_stamp: "Formatted at 2026-08-08 05:07:39 on dist-test-slave-7kzw"
server_key: "c3e3bacdf6ee6f35244a13c55cadda72"
server_key_iv: "424fb70bab143083be8aef54dec42692"
server_key_version: "encryptionkey@0"
I20260808 05:07:39.281569 10932 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "52b87323f7534363844547b1a37f5cf7"
format_stamp: "Formatted at 2026-08-08 05:07:39 on dist-test-slave-7kzw"
server_key: "c3e3bacdf6ee6f35244a13c55cadda72"
server_key_iv: "424fb70bab143083be8aef54dec42692"
server_key_version: "encryptionkey@0"
I20260808 05:07:39.283002 10932 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:39.283835 10950 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:39.284090 10932 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:39.284190 10932 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "52b87323f7534363844547b1a37f5cf7"
format_stamp: "Formatted at 2026-08-08 05:07:39 on dist-test-slave-7kzw"
server_key: "c3e3bacdf6ee6f35244a13c55cadda72"
server_key_iv: "424fb70bab143083be8aef54dec42692"
server_key_version: "encryptionkey@0"
I20260808 05:07:39.284272 10932 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:39.296991 10932 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:39.299410 10932 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:39.299532 10932 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:39.304107 10932 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:34063
I20260808 05:07:39.304204 11029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:34063 every 8 connection(s)
I20260808 05:07:39.304548 10932 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:39.305534 11032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:39.307268 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 10932
I20260808 05:07:39.307399 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:39.307613 11547 external_mini_cluster.cc:1428] Setting key e9c990e7dcc4451f0e6039ef7687f058
I20260808 05:07:39.308585 11032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7: Bootstrap starting.
I20260808 05:07:39.309273 11032 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:39.309659 11032 log.cc:824] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:39.310448 11032 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7: No bootstrap required, opened a new log
I20260808 05:07:39.312933 11032 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b87323f7534363844547b1a37f5cf7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34063 } }
I20260808 05:07:39.313109 11032 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:39.313153 11032 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52b87323f7534363844547b1a37f5cf7, State: Initialized, Role: FOLLOWER
I20260808 05:07:39.313297 11032 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b87323f7534363844547b1a37f5cf7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34063 } }
I20260808 05:07:39.313400 11032 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:39.313436 11032 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:39.313491 11032 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:39.314276 11032 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b87323f7534363844547b1a37f5cf7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34063 } }
I20260808 05:07:39.314400 11032 leader_election.cc:302] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52b87323f7534363844547b1a37f5cf7; no voters:
I20260808 05:07:39.314620 11032 leader_election.cc:288] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:39.314654 11038 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:39.314783 11038 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [term 1 LEADER]: Becoming Leader. State: Replica: 52b87323f7534363844547b1a37f5cf7, State: Running, Role: LEADER
I20260808 05:07:39.314888 11032 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:39.314858 11038 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b87323f7534363844547b1a37f5cf7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34063 } }
Aug 08 05:07:39 dist-test-slave-7kzw krb5kdc[10916](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165659, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:39.317188 11040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52b87323f7534363844547b1a37f5cf7. Latest consensus state: current_term: 1 leader_uuid: "52b87323f7534363844547b1a37f5cf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b87323f7534363844547b1a37f5cf7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34063 } } }
I20260808 05:07:39.317276 11040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:39.317582 11061 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:39.317716 11039 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52b87323f7534363844547b1a37f5cf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52b87323f7534363844547b1a37f5cf7" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34063 } } }
I20260808 05:07:39.317813 11039 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:39.318203 11061 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:39.319535 11036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:39.308204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50309 (local address 127.11.70.254:34063)
0808 05:07:39.308382 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:39.308390 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:39.308417 (+ 27us) server_negotiation.cc:407] Connection header received
0808 05:07:39.308887 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:39.308895 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:39.308944 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:39.309062 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:39.309944 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:39.311060 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:39.312118 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:39.312513 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:39.312593 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:39.315545 (+ 2952us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:39.315550 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:39.315550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:39.315565 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:39.317663 (+ 2098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:39.318211 (+ 548us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:39.318214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:39.318215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:39.318343 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:39.318581 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:39.318582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:39.318582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:39.318841 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:39.319013 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:39.319134 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 05:07:39.319284 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":85,"threads_started":1}
I20260808 05:07:39.320205 11061 catalog_manager.cc:1347] Generated new cluster ID: b30f64e036904c369ba7f7f96b7a93b2
I20260808 05:07:39.320257 11061 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:39.320608 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:39.324836 11061 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:39.325485 11061 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:39.329589 11036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:39.322057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35987 (local address 127.11.70.254:34063)
0808 05:07:39.322091 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:39.322093 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:39.322249 (+ 156us) server_negotiation.cc:407] Connection header received
0808 05:07:39.322290 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:39.322291 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:39.322301 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:39.322359 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:39.323036 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:39.323757 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:39.324881 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:39.325203 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:39.325284 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:39.326773 (+ 1489us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:39.326775 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:39.326776 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:39.326783 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:39.328361 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:39.328776 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:39.328777 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:39.328777 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:39.328837 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:39.329063 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:39.329064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:39.329064 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:39.329179 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:39.329273 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:39.329414 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 05:07:39.329501 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:07:39.336843 11061 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52b87323f7534363844547b1a37f5cf7: Generated new TSK 0
I20260808 05:07:39.337060 11061 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:39.343767 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 10932
2026-08-08T05:07:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1602 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:39 dist-test-slave-7kzw krb5kdc[11075](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:39 dist-test-slave-7kzw krb5kdc[11075](info): set up 2 sockets
Aug 08 05:07:39 dist-test-slave-7kzw krb5kdc[11075](info): commencing operation
krb5kdc: starting...
W20260808 05:07:40.638585 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.268s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:40 dist-test-slave-7kzw krb5kdc[11075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165660, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:40.774557 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:39193
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:38645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:39193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:40.858493 11094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:40.858760 11094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:40.858800 11094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:40.859987 11094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:40.860066 11094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:40.860090 11094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:40.860132 11094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:40.860155 11094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:40.861683 11094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:38645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:39193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:39193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:40.861974 11094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:40.862218 11094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:40.867408 11102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:40.867452 11107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:40.867475 11094 server_base.cc:1034] running on GCE node
W20260808 05:07:40.867413 11104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:40.867923 11094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:40.868176 11094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:40.869377 11094 hybrid_clock.cc:648] HybridClock initialized: now 1786165660869366 us; error 44 us; skew 500 ppm
Aug 08 05:07:40 dist-test-slave-7kzw krb5kdc[11075](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165660, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:40.872339 11094 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:40.872763 11094 webserver.cc:460] Webserver started at http://127.11.70.254:32793/ using document root <none> and password file <none>
I20260808 05:07:40.872978 11094 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:40.873024 11094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:40.873131 11094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:40.874213 11094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "24a8a2fb54a74af88e49d125bf281bb0"
format_stamp: "Formatted at 2026-08-08 05:07:40 on dist-test-slave-7kzw"
server_key: "b2f42c477868dd4dfd1ec25a4ad91e23"
server_key_iv: "1016506c31ab1a3be21805117280ae1d"
server_key_version: "encryptionkey@0"
I20260808 05:07:40.874634 11094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "24a8a2fb54a74af88e49d125bf281bb0"
format_stamp: "Formatted at 2026-08-08 05:07:40 on dist-test-slave-7kzw"
server_key: "b2f42c477868dd4dfd1ec25a4ad91e23"
server_key_iv: "1016506c31ab1a3be21805117280ae1d"
server_key_version: "encryptionkey@0"
I20260808 05:07:40.876099 11094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:40.877015 11115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:40.877254 11094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:40.877345 11094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "24a8a2fb54a74af88e49d125bf281bb0"
format_stamp: "Formatted at 2026-08-08 05:07:40 on dist-test-slave-7kzw"
server_key: "b2f42c477868dd4dfd1ec25a4ad91e23"
server_key_iv: "1016506c31ab1a3be21805117280ae1d"
server_key_version: "encryptionkey@0"
I20260808 05:07:40.877401 11094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:40.888749 11094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:40.891089 11094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:40.891206 11094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:40.895273 11094 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:39193
I20260808 05:07:40.895324 11205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:39193 every 8 connection(s)
I20260808 05:07:40.895682 11094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:40.896610 11207 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:40.898996 11207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0: Bootstrap starting.
I20260808 05:07:40.899880 11207 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:40.900211 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 11094
I20260808 05:07:40.900220 11207 log.cc:824] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:40.900332 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:40.900532 11547 external_mini_cluster.cc:1428] Setting key 98de066d5242f767d734e87060f33409
I20260808 05:07:40.901371 11207 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0: No bootstrap required, opened a new log
I20260808 05:07:40.904131 11207 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a8a2fb54a74af88e49d125bf281bb0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39193 } }
I20260808 05:07:40.904312 11207 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:40.904349 11207 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24a8a2fb54a74af88e49d125bf281bb0, State: Initialized, Role: FOLLOWER
I20260808 05:07:40.904487 11207 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a8a2fb54a74af88e49d125bf281bb0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39193 } }
I20260808 05:07:40.904561 11207 raft_consensus.cc:388] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:40.904584 11207 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:40.904661 11207 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:40.905388 11207 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a8a2fb54a74af88e49d125bf281bb0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39193 } }
I20260808 05:07:40.905493 11207 leader_election.cc:302] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 24a8a2fb54a74af88e49d125bf281bb0; no voters:
I20260808 05:07:40.905710 11207 leader_election.cc:288] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:40.905751 11215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:40.905866 11215 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [term 1 LEADER]: Becoming Leader. State: Replica: 24a8a2fb54a74af88e49d125bf281bb0, State: Running, Role: LEADER
I20260808 05:07:40.905951 11215 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a8a2fb54a74af88e49d125bf281bb0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39193 } }
I20260808 05:07:40.906019 11207 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:40.906296 11218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "24a8a2fb54a74af88e49d125bf281bb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a8a2fb54a74af88e49d125bf281bb0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39193 } } }
I20260808 05:07:40.906414 11218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:40.906869 11226 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:40.906939 11212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:40.901154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53561 (local address 127.11.70.254:39193)
0808 05:07:40.901352 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:40.901361 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:40.901394 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:07:40.901876 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:40.901889 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:40.901939 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:40.902049 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:40.902277 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:40.903210 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:40.904440 (+ 1230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:40.904994 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:40.905083 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:40.905889 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:40.905894 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:40.905894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:40.906217 (+ 323us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:40.906259 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:40.906275 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:40.906348 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:40.906590 (+ 242us) server_negotiation.cc:299] Negotiation successful
0808 05:07:40.906684 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
I20260808 05:07:40.906280 11215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24a8a2fb54a74af88e49d125bf281bb0. Latest consensus state: current_term: 1 leader_uuid: "24a8a2fb54a74af88e49d125bf281bb0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "24a8a2fb54a74af88e49d125bf281bb0" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 39193 } } }
I20260808 05:07:40.907373 11215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:40.907897 11226 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:40.908102 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:40.909657 11226 catalog_manager.cc:1347] Generated new cluster ID: 302160a7fb734d73a174d0662575d6c3
I20260808 05:07:40.909720 11226 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:40.913892 11212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:40.909633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47067 (local address 127.11.70.254:39193)
0808 05:07:40.910550 (+ 917us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:40.910553 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:40.910562 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:40.910583 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:40.910584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:40.910596 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:40.910670 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:40.910833 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:40.911560 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:40.912517 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:40.912834 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:40.912909 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:40.913620 (+ 711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:40.913621 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:40.913621 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:40.913627 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:40.913644 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:40.913649 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:40.913717 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:40.913780 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 05:07:40.913803 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":895}
I20260808 05:07:40.921618 11226 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:40.922173 11226 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:40.932921 11226 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 24a8a2fb54a74af88e49d125bf281bb0: Generated new TSK 0
I20260808 05:07:40.933128 11226 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:40.944065 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 11094
2026-08-08T05:07:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1601 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:41 dist-test-slave-7kzw krb5kdc[11252](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:41 dist-test-slave-7kzw krb5kdc[11252](info): set up 2 sockets
Aug 08 05:07:41 dist-test-slave-7kzw krb5kdc[11252](info): commencing operation
krb5kdc: starting...
W20260808 05:07:42.255169 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:42 dist-test-slave-7kzw krb5kdc[11252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165662, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:42.389139 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43491
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:40887
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:43491
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:42.472976 11271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:42.473207 11271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:42.473232 11271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:42.474511 11271 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:42.474557 11271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:42.474572 11271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:42.474586 11271 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:42.474597 11271 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:42.476137 11271 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:40887
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:43491
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:43491
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:42.476405 11271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:42.476652 11271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:42.481638 11277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:42.481658 11278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:42.481667 11280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:42.482012 11271 server_base.cc:1034] running on GCE node
I20260808 05:07:42.482255 11271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:42.482568 11271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:42.483729 11271 hybrid_clock.cc:648] HybridClock initialized: now 1786165662483708 us; error 38 us; skew 500 ppm
Aug 08 05:07:42 dist-test-slave-7kzw krb5kdc[11252](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165662, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:42.491636 11271 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:42.492093 11271 webserver.cc:460] Webserver started at http://127.11.70.254:36229/ using document root <none> and password file <none>
I20260808 05:07:42.492326 11271 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:42.492374 11271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:42.492476 11271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:42.493544 11271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "4305de991b344831b8e221c8ab80c6ba"
format_stamp: "Formatted at 2026-08-08 05:07:42 on dist-test-slave-7kzw"
server_key: "fe99955b32674d4a76b1eda62d3fa2fe"
server_key_iv: "d19004f473dc55bdfc9b34e81b15c3bb"
server_key_version: "encryptionkey@0"
I20260808 05:07:42.493877 11271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "4305de991b344831b8e221c8ab80c6ba"
format_stamp: "Formatted at 2026-08-08 05:07:42 on dist-test-slave-7kzw"
server_key: "fe99955b32674d4a76b1eda62d3fa2fe"
server_key_iv: "d19004f473dc55bdfc9b34e81b15c3bb"
server_key_version: "encryptionkey@0"
I20260808 05:07:42.495451 11271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:42.496302 11289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:42.496503 11271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:42.496623 11271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "4305de991b344831b8e221c8ab80c6ba"
format_stamp: "Formatted at 2026-08-08 05:07:42 on dist-test-slave-7kzw"
server_key: "fe99955b32674d4a76b1eda62d3fa2fe"
server_key_iv: "d19004f473dc55bdfc9b34e81b15c3bb"
server_key_version: "encryptionkey@0"
I20260808 05:07:42.496722 11271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:42.500397 11271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:42.502908 11271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:42.503082 11271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:42.507356 11271 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:43491
I20260808 05:07:42.507411 11371 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:43491 every 8 connection(s)
I20260808 05:07:42.507826 11271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:42.508839 11372 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:42.511143 11372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba: Bootstrap starting.
I20260808 05:07:42.511699 11372 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:42.511942 11372 log.cc:824] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:42.512627 11372 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba: No bootstrap required, opened a new log
I20260808 05:07:42.514197 11372 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4305de991b344831b8e221c8ab80c6ba" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43491 } }
I20260808 05:07:42.514375 11372 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:42.514420 11372 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4305de991b344831b8e221c8ab80c6ba, State: Initialized, Role: FOLLOWER
I20260808 05:07:42.514560 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 11271
I20260808 05:07:42.514597 11372 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4305de991b344831b8e221c8ab80c6ba" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43491 } }
I20260808 05:07:42.514683 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:42.514698 11372 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:42.514734 11372 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:42.514798 11372 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:42.514911 11547 external_mini_cluster.cc:1428] Setting key d4b3bf71184d67605c9bc78c071588d4
I20260808 05:07:42.515882 11372 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4305de991b344831b8e221c8ab80c6ba" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43491 } }
I20260808 05:07:42.516043 11372 leader_election.cc:302] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4305de991b344831b8e221c8ab80c6ba; no voters:
I20260808 05:07:42.516224 11372 leader_election.cc:288] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:42.516399 11379 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:42.516497 11372 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:42.516582 11379 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [term 1 LEADER]: Becoming Leader. State: Replica: 4305de991b344831b8e221c8ab80c6ba, State: Running, Role: LEADER
I20260808 05:07:42.516692 11379 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4305de991b344831b8e221c8ab80c6ba" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43491 } }
I20260808 05:07:42.517053 11380 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4305de991b344831b8e221c8ab80c6ba. Latest consensus state: current_term: 1 leader_uuid: "4305de991b344831b8e221c8ab80c6ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4305de991b344831b8e221c8ab80c6ba" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43491 } } }
I20260808 05:07:42.517184 11380 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:42.517287 11377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:42.515430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51287 (local address 127.11.70.254:43491)
0808 05:07:42.515641 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:42.515653 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:42.515684 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:07:42.515787 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:42.515793 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:42.515820 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:42.515934 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:42.516646 (+ 712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:42.516650 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:42.516651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:42.516656 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:42.516710 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:42.516737 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:42.516795 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:42.516954 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 05:07:42.516999 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":110,"threads_started":1}
I20260808 05:07:42.517460 11387 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:42.517109 11378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4305de991b344831b8e221c8ab80c6ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4305de991b344831b8e221c8ab80c6ba" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 43491 } } }
I20260808 05:07:42.517876 11378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:42.518002 11387 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:42.518309 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:42.519846 11387 catalog_manager.cc:1347] Generated new cluster ID: 5ff32d75dbc245a0a135301f82d23bd2
I20260808 05:07:42.519907 11387 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:42.523938 11377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:42.522735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59245 (local address 127.11.70.254:43491)
0808 05:07:42.522775 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:42.522777 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:42.522922 (+ 145us) server_negotiation.cc:407] Connection header received
0808 05:07:42.522980 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:42.522981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:42.522987 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:42.523041 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:42.523649 (+ 608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:42.523650 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:42.523651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:07:42.523655 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:42.523694 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:07:42.523699 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:42.523765 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:42.523839 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 05:07:42.523862 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:07:42.525305 11387 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:42.525470 11387 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:42.531299 11387 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4305de991b344831b8e221c8ab80c6ba: Generated new TSK 0
I20260808 05:07:42.531486 11387 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:42.535678 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 11271
2026-08-08T05:07:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1592 ms)
[----------] 18 tests from AuthTokenIssuingTest (28234 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:42 dist-test-slave-7kzw krb5kdc[11410](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:42 dist-test-slave-7kzw krb5kdc[11410](info): set up 2 sockets
Aug 08 05:07:42 dist-test-slave-7kzw krb5kdc[11410](info): commencing operation
krb5kdc: starting...
W20260808 05:07:43.769378 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.205s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:43 dist-test-slave-7kzw krb5kdc[11410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:43.901934 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34677
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:34677,127.11.70.253:38683,127.11.70.252:46171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:43.985620 11427 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:07:43.985843 11427 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:43.985862 11427 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:43.985881 11427 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:43.987084 11427 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:43.987128 11427 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:43.987141 11427 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:43.987156 11427 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:43.987211 11427 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:43.988722 11427 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:34677,127.11.70.253:38683,127.11.70.252:46171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:34677
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11427
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:43.988983 11427 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:43.989223 11427 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:43.994601 11433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:43.994623 11432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:43.994612 11427 server_base.cc:1034] running on GCE node
W20260808 05:07:43.994781 11435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:43.995096 11427 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:43.995424 11427 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:43.996579 11427 hybrid_clock.cc:648] HybridClock initialized: now 1786165663996561 us; error 43 us; skew 500 ppm
Aug 08 05:07:43 dist-test-slave-7kzw krb5kdc[11410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:43.999331 11427 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:43.999846 11427 webserver.cc:460] Webserver started at http://127.11.70.254:39287/ using document root <none> and password file <none>
I20260808 05:07:44.000095 11427 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:44.000141 11427 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:44.000273 11427 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:44.001362 11427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "b359954511a74024aeca94d007489a0a"
format_stamp: "Formatted at 2026-08-08 05:07:43 on dist-test-slave-7kzw"
server_key: "b0c30b83f73163c45beeb5c6d0a47019"
server_key_iv: "9194b204590e80a790bc2bb2dfcbd4b3"
server_key_version: "encryptionkey@0"
I20260808 05:07:44.001744 11427 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "b359954511a74024aeca94d007489a0a"
format_stamp: "Formatted at 2026-08-08 05:07:43 on dist-test-slave-7kzw"
server_key: "b0c30b83f73163c45beeb5c6d0a47019"
server_key_iv: "9194b204590e80a790bc2bb2dfcbd4b3"
server_key_version: "encryptionkey@0"
I20260808 05:07:44.003276 11427 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:44.004127 11444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:44.004463 11427 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:44.004559 11427 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "b359954511a74024aeca94d007489a0a"
format_stamp: "Formatted at 2026-08-08 05:07:43 on dist-test-slave-7kzw"
server_key: "b0c30b83f73163c45beeb5c6d0a47019"
server_key_iv: "9194b204590e80a790bc2bb2dfcbd4b3"
server_key_version: "encryptionkey@0"
I20260808 05:07:44.004617 11427 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:44.017743 11427 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:44.020138 11427 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:44.020275 11427 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:44.024564 11427 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:34677
I20260808 05:07:44.024636 11527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:34677 every 8 connection(s)
I20260808 05:07:44.025015 11427 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:44.026093 11528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:44.027618 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 11427
I20260808 05:07:44.027772 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:44.027961 11547 external_mini_cluster.cc:1428] Setting key 9ae921a9dd1b49ee71c49fecfa8e5a33
I20260808 05:07:44.027884 11528 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.70.253@KRBTEST.COM; defaulting to no policy
I20260808 05:07:44.038687 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.028680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53852 (local address 127.11.70.254:34677)
0808 05:07:44.028908 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.028912 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.028971 (+ 59us) server_negotiation.cc:407] Connection header received
0808 05:07:44.029541 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.029543 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.029563 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.029670 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.030241 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.031153 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.032047 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.032366 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.032487 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.034975 (+ 2488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.034985 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.034985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.034993 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.036972 (+ 1979us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.037425 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.037427 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.037428 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.037508 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.037747 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.037748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.037749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.037969 (+ 220us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.038068 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.038328 (+ 260us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.038435 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":104,"threads_started":1}
I20260808 05:07:44.038702 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.028646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34677 (local address 127.0.0.1:53852)
0808 05:07:44.028838 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.028884 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:44.029380 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:44.029683 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:44.029686 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:44.029977 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:44.030135 (+ 158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.030139 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.031277 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.031278 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.031946 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.031947 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.032471 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.032472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.032539 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.033114 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:44.033123 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:44.034870 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:44.037064 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.037071 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.037072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.037283 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.037582 (+ 299us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.037583 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.037583 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.037677 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.038044 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:44.038050 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:44.038152 (+ 102us) client_negotiation.cc:769] Sending connection context
0808 05:07:44.038293 (+ 141us) client_negotiation.cc:240] Negotiation successful
0808 05:07:44.038575 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":73,"thread_start_us":110,"threads_started":1}
I20260808 05:07:44.039551 11528 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:44.039963 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.039814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:38683 (local address 127.0.0.1:46132)
0808 05:07:44.039886 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.039934 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.253@KRBTEST.COM" created.
W20260808 05:07:44.040117 11446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
I20260808 05:07:44.040517 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.040424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:38683 (local address 127.0.0.1:46148)
0808 05:07:44.040471 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.040495 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 05:07:44.040628 11528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.253:38683: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab.
Entry for principal kudu/127.11.70.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab.
I20260808 05:07:44.057680 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.253:38683
--webserver_interface=127.11.70.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab
--principal=kudu/127.11.70.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:34677,127.11.70.253:38683,127.11.70.252:46171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:07:44.089907 11528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } attempt: 1
I20260808 05:07:44.090502 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.090317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:38683 (local address 127.0.0.1:46164)
0808 05:07:44.090391 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.090442 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 05:07:44.091034 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.090919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:38683 (local address 127.0.0.1:46168)
0808 05:07:44.090954 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.090988 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 05:07:44.091140 11528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.253:38683: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
W20260808 05:07:44.142494 11538 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:07:44.142705 11538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:44.142722 11538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:44.142743 11538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:44.143929 11538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:44.143970 11538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:44.143985 11538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:44.143997 11538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:44.144009 11538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:44.145521 11538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:34677,127.11.70.253:38683,127.11.70.252:46171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab
--principal=kudu/127.11.70.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.253:38683
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.70.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:44.145792 11538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:44.146039 11538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:44.151073 11556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:44.151073 11546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:44.151167 11559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:44.151271 11538 server_base.cc:1034] running on GCE node
I20260808 05:07:44.151649 11538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:44.151938 11538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:44.153087 11538 hybrid_clock.cc:648] HybridClock initialized: now 1786165664153061 us; error 51 us; skew 500 ppm
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165664, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:44.155934 11538 init.cc:377] Logged in from keytab as kudu/127.11.70.253@KRBTEST.COM (short username kudu)
I20260808 05:07:44.156423 11538 webserver.cc:460] Webserver started at http://127.11.70.253:45837/ using document root <none> and password file <none>
I20260808 05:07:44.156651 11538 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:44.156728 11538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:44.156884 11538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:44.157953 11538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/data/instance:
uuid: "75cc1d12d6e049028d6436f02101d324"
format_stamp: "Formatted at 2026-08-08 05:07:44 on dist-test-slave-7kzw"
server_key: "776dd8e3bf7a0a7985237f3e4207ed80"
server_key_iv: "5ec36b6d14810cb302783c0776740fd0"
server_key_version: "encryptionkey@0"
I20260808 05:07:44.158327 11538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/wal/instance:
uuid: "75cc1d12d6e049028d6436f02101d324"
format_stamp: "Formatted at 2026-08-08 05:07:44 on dist-test-slave-7kzw"
server_key: "776dd8e3bf7a0a7985237f3e4207ed80"
server_key_iv: "5ec36b6d14810cb302783c0776740fd0"
server_key_version: "encryptionkey@0"
I20260808 05:07:44.159278 11528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } attempt: 2
I20260808 05:07:44.159739 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.159573 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:38683 (local address 127.0.0.1:46180)
0808 05:07:44.159643 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.159705 (+ 62us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260808 05:07:44.159893 11538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:44.160138 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.160040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:38683 (local address 127.0.0.1:46194)
0808 05:07:44.160073 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.160107 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 05:07:44.160254 11528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.253:38683: Network error: Client connection negotiation failed: client connection to 127.11.70.253:38683: connect: Connection refused (error 111)
I20260808 05:07:44.160843 11570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:44.161056 11538 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:44.161171 11538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/wal
uuid: "75cc1d12d6e049028d6436f02101d324"
format_stamp: "Formatted at 2026-08-08 05:07:44 on dist-test-slave-7kzw"
server_key: "776dd8e3bf7a0a7985237f3e4207ed80"
server_key_iv: "5ec36b6d14810cb302783c0776740fd0"
server_key_version: "encryptionkey@0"
I20260808 05:07:44.161259 11538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:44.175596 11538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:44.178007 11538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:44.178185 11538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:44.182361 11538 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.253:38683
I20260808 05:07:44.182415 11643 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.253:38683 every 8 connection(s)
I20260808 05:07:44.182811 11538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
I20260808 05:07:44.183223 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 11538
I20260808 05:07:44.183380 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-1/wal/instance
I20260808 05:07:44.183643 11547 external_mini_cluster.cc:1428] Setting key 5d47f2c995502053af095514682dc7aa
I20260808 05:07:44.184106 11644 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:44.186353 11644 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.70.252@KRBTEST.COM; defaulting to no policy
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165664, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.252@KRBTEST.COM" created.
I20260808 05:07:44.196183 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.187185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53862 (local address 127.11.70.254:34677)
0808 05:07:44.187265 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.187267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.187497 (+ 230us) server_negotiation.cc:407] Connection header received
0808 05:07:44.188039 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.188041 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.188053 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.188119 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.188805 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.189301 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.190304 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.190578 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.190655 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.193115 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.193117 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.193118 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.193128 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.194660 (+ 1532us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.195103 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.195104 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.195105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.195170 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.195453 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.195454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.195455 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.195622 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.195712 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.196025 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.196113 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:07:44.196467 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.187158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34677 (local address 127.0.0.1:53862)
0808 05:07:44.187375 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.187411 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:44.187927 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:44.188189 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:44.188193 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:44.188499 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:44.188699 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.188703 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.189405 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.189406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.190205 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.190207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.190693 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.190695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.190869 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.191391 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:44.191410 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:44.193014 (+ 1604us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:44.194763 (+ 1749us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.194771 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.194773 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.195007 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.195241 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.195242 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.195242 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.195369 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.195705 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:44.195711 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:44.195870 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 05:07:44.195999 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 05:07:44.196182 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":109,"threads_started":1}
I20260808 05:07:44.197120 11644 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165664, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:07:44.205137 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.197407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:38683 (local address 127.0.0.1:46210)
0808 05:07:44.197456 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.197466 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:44.197502 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:44.197818 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:44.197820 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:44.197989 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:44.198066 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.198068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.198987 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.198988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.199870 (+ 882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.199873 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.200381 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.200383 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.200465 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.200884 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:44.200891 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:44.202231 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:44.204027 (+ 1796us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.204028 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.204028 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.204201 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.204433 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.204434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.204434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.204493 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.204802 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:44.204803 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:44.204844 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 05:07:44.204911 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:07:44.205013 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:07:44.205206 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.197485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46210 (local address 127.11.70.253:38683)
0808 05:07:44.197653 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.197658 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.197679 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:07:44.197699 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.197701 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.197714 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.197789 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.198148 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.198892 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.199964 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.200305 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.200361 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.202325 (+ 1964us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.202334 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.202335 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.202342 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.203938 (+ 1596us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.204305 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.204312 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.204313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.204363 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.204575 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.204575 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.204576 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.204719 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.204813 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.204951 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.205069 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":47,"server-negotiator.queue_time_us":136,"thread_start_us":99,"threads_started":1}
I20260808 05:07:44.205894 11644 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:44.206269 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.206142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49126)
0808 05:07:44.206187 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.206233 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 05:07:44.206411 11571 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
I20260808 05:07:44.206956 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.206820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49128)
0808 05:07:44.206895 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.206925 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260808 05:07:44.207110 11644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:46171: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab.
Entry for principal kudu/127.11.70.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab.
I20260808 05:07:44.213534 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.252:46171
--webserver_interface=127.11.70.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab
--principal=kudu/127.11.70.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:41585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:34677,127.11.70.253:38683,127.11.70.252:46171
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:07:44.251441 11528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } attempt: 3
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:07:44.256325 11644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } attempt: 1
I20260808 05:07:44.256752 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.256589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49140)
0808 05:07:44.256654 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.256691 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 05:07:44.257334 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.257216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49148)
0808 05:07:44.257265 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.257298 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 05:07:44.257638 11644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:46171: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
I20260808 05:07:44.259353 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.251957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46222 (local address 127.11.70.253:38683)
0808 05:07:44.252030 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.252032 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.252044 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:07:44.252097 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.252098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.252108 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.252183 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.252516 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.253087 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.253819 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.254054 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.254136 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.256384 (+ 2248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.256385 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.256386 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.256394 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.258124 (+ 1730us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.258567 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.258568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.258569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.258632 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.258871 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.258872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.258872 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.258996 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.259070 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.259232 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.259299 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:07:44.259449 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.251871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:38683 (local address 127.0.0.1:46222)
0808 05:07:44.251940 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.251951 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:44.252017 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:44.252192 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:44.252193 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:44.252367 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:44.252434 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.252436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.253197 (+ 761us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.253199 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.253736 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.253738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.254134 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.254135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.254218 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.254740 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:44.254746 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:44.256286 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:44.258222 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.258224 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.258224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.258493 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.258696 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.258697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.258697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.258780 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.259065 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:44.259066 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:44.259121 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 05:07:44.259205 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:07:44.259337 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260808 05:07:44.259892 11528 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:44.260258 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.260133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49164)
0808 05:07:44.260183 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.260221 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:07:44.260593 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.260500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49174)
0808 05:07:44.260544 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.260573 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260808 05:07:44.260692 11528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:46171: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
I20260808 05:07:44.291862 11528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } attempt: 1
I20260808 05:07:44.292462 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.292292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49178)
0808 05:07:44.292368 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.292419 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 05:07:44.292927 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.292814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49184)
0808 05:07:44.292865 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.292899 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 05:07:44.293084 11528 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:46171: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
W20260808 05:07:44.301297 11656 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:07:44.301522 11656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:44.301540 11656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:44.301561 11656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:44.302791 11656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:44.302835 11656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:44.302850 11656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:44.302862 11656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:44.302875 11656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:44.304395 11656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:41585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:34677,127.11.70.253:38683,127.11.70.252:46171
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab
--principal=kudu/127.11.70.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.252:46171
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.70.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:44.304764 11656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:44.305042 11656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:44.310213 11663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:44.310249 11664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:44.310307 11656 server_base.cc:1034] running on GCE node
W20260808 05:07:44.310249 11666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:44.310832 11656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:44.311097 11656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:44.312249 11656 hybrid_clock.cc:648] HybridClock initialized: now 1786165664312239 us; error 32 us; skew 500 ppm
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165664, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:44.314837 11656 init.cc:377] Logged in from keytab as kudu/127.11.70.252@KRBTEST.COM (short username kudu)
I20260808 05:07:44.315291 11656 webserver.cc:460] Webserver started at http://127.11.70.252:43277/ using document root <none> and password file <none>
I20260808 05:07:44.315523 11656 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:44.315598 11656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:44.315758 11656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:44.316825 11656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/data/instance:
uuid: "7f0d618bfbc546138a8a10b27c6a8ea3"
format_stamp: "Formatted at 2026-08-08 05:07:44 on dist-test-slave-7kzw"
server_key: "63a7db636f9bf747daf433884f2bdc6b"
server_key_iv: "4a06d53873c67b4ff8d016ff63c14b43"
server_key_version: "encryptionkey@0"
I20260808 05:07:44.317220 11656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/wal/instance:
uuid: "7f0d618bfbc546138a8a10b27c6a8ea3"
format_stamp: "Formatted at 2026-08-08 05:07:44 on dist-test-slave-7kzw"
server_key: "63a7db636f9bf747daf433884f2bdc6b"
server_key_iv: "4a06d53873c67b4ff8d016ff63c14b43"
server_key_version: "encryptionkey@0"
I20260808 05:07:44.318861 11656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:07:44.319737 11676 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:44.319923 11656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:44.320040 11656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/wal
uuid: "7f0d618bfbc546138a8a10b27c6a8ea3"
format_stamp: "Formatted at 2026-08-08 05:07:44 on dist-test-slave-7kzw"
server_key: "63a7db636f9bf747daf433884f2bdc6b"
server_key_iv: "4a06d53873c67b4ff8d016ff63c14b43"
server_key_version: "encryptionkey@0"
I20260808 05:07:44.320128 11656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:44.325796 11644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } attempt: 2
I20260808 05:07:44.326242 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.326106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49188)
0808 05:07:44.326168 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.326210 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 05:07:44.326639 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.326549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49194)
0808 05:07:44.326593 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.326619 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 05:07:44.326757 11644 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:46171: Network error: Client connection negotiation failed: client connection to 127.11.70.252:46171: connect: Connection refused (error 111)
I20260808 05:07:44.334880 11656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:44.336910 11656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:44.337070 11656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:44.341187 11656 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.252:46171
I20260808 05:07:44.341259 11749 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.252:46171 every 8 connection(s)
I20260808 05:07:44.341605 11656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
I20260808 05:07:44.342711 11750 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:44.344316 11750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:44.349783 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 11656
I20260808 05:07:44.349884 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165386228479-11547-0/minicluster-data/master-2/wal/instance
I20260808 05:07:44.350082 11547 external_mini_cluster.cc:1428] Setting key 498df14945b1dd6df0de19a26501f641
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165664, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:44.354031 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.345061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53864 (local address 127.11.70.254:34677)
0808 05:07:44.345144 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.345146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.345363 (+ 217us) server_negotiation.cc:407] Connection header received
0808 05:07:44.345802 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.345803 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.345814 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.345877 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.346550 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.347034 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.348210 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.348398 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.348460 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.350938 (+ 2478us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.350939 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.350939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.350945 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.352465 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.352962 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.352963 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.352963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.353051 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.353317 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.353318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.353318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.353461 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.353546 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.353893 (+ 347us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.353962 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260808 05:07:44.354259 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.344985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:34677 (local address 127.0.0.1:53864)
0808 05:07:44.345204 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.345246 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:44.345693 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:44.345956 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:44.345959 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:44.346209 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:44.346409 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.346413 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.347118 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.347119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.348121 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.348124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.348494 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.348495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.348604 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.349162 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:44.349171 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:44.350856 (+ 1685us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:44.352548 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.352554 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.352557 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.352873 (+ 316us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.353128 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.353129 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.353129 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.353236 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.353557 (+ 321us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:44.353564 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:44.353697 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 05:07:44.353852 (+ 155us) client_negotiation.cc:240] Negotiation successful
0808 05:07:44.354012 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":116,"threads_started":1}
I20260808 05:07:44.354934 11750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165664, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:07:44.360634 11756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.350528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49204 (local address 127.11.70.252:46171)
0808 05:07:44.350735 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.350739 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.350768 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:07:44.350812 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.350814 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.350841 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.350924 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.351962 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.352717 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.353793 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.354273 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.354349 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.357208 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.357216 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.357216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.357224 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.359244 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.359612 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.359615 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.359615 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.359678 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.359958 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.359959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.359960 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.360161 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.360333 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.360411 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.360513 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":147,"threads_started":1}
I20260808 05:07:44.362394 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.355209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:38683 (local address 127.0.0.1:46228)
0808 05:07:44.355342 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.355353 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:44.355421 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:44.355548 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:44.355549 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:44.355720 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:44.355782 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.355784 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.356555 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.356556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.357157 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.357178 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.357537 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.357538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.357621 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.357975 (+ 354us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:44.357979 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:44.359350 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:44.361297 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.361297 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.361298 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.361489 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.361733 (+ 244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.361734 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.361735 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.361795 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.362073 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:44.362074 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:44.362116 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 05:07:44.362195 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:07:44.362298 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260808 05:07:44.362398 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.355288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46228 (local address 127.11.70.253:38683)
0808 05:07:44.355335 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.355337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.355396 (+ 59us) server_negotiation.cc:407] Connection header received
0808 05:07:44.355488 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.355489 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.355497 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.355541 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.355854 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.356463 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.357261 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.357449 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.357526 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.359444 (+ 1918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.359445 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.359446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.359452 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.361184 (+ 1732us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.361592 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.361593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.361594 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.361664 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.361871 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.361872 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.361873 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.361993 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.362067 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.362236 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.362307 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:07:44.363270 11750 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165664, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:07:44.368305 11528 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } attempt: 2
I20260808 05:07:44.369719 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.361567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53866 (local address 127.11.70.254:34677)
0808 05:07:44.361632 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.361634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.361643 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:44.361669 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.361669 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.361678 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.361723 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.362182 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.362816 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.363645 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.363885 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.363968 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.366827 (+ 2859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.366828 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.366829 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.366837 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.368510 (+ 1673us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.368933 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.368934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.368934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.369002 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.369194 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.369195 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.369196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.369314 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.369492 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.369530 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.369602 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:07:44.370903 11753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.363526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49220)
0808 05:07:44.363577 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.363586 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:44.363623 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:44.363961 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:44.363962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:44.364102 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:44.364130 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.364131 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.365102 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.365103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.365643 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.365646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.365999 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.366000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.366056 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.366380 (+ 324us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:44.366384 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:44.367781 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:44.369725 (+ 1944us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.369725 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.369726 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.369985 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.370181 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.370182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.370182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.370255 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.370537 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:44.370537 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:44.370576 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 05:07:44.370644 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 05:07:44.370745 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 05:07:44.370978 11756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.363660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49220 (local address 127.11.70.252:46171)
0808 05:07:44.363698 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.363700 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.363831 (+ 131us) server_negotiation.cc:407] Connection header received
0808 05:07:44.363861 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.363862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.363873 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.363941 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.364206 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.364983 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.365728 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.365920 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.365974 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.367868 (+ 1894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.367869 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.367869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.367875 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.369637 (+ 1762us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.370063 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.370064 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.370065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.370119 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.370330 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.370330 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.370331 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.370457 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.370545 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.370677 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.370799 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":19}
I20260808 05:07:44.372709 11750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3: Bootstrap starting.
I20260808 05:07:44.373499 11750 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:44.373914 11750 log.cc:824] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:44.374850 11750 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3: No bootstrap required, opened a new log
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165663, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:07:44.377080 11750 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } }
I20260808 05:07:44.377274 11750 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f0d618bfbc546138a8a10b27c6a8ea3, State: Initialized, Role: FOLLOWER
I20260808 05:07:44.377364 11750 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } }
I20260808 05:07:44.377746 11750 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:44.377753 11760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.377998 11760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:44.380165 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.370313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46242 (local address 127.11.70.253:38683)
0808 05:07:44.370350 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.370352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.370359 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:07:44.370420 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.370421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.370429 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.370521 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.371885 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.372314 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.373217 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.373403 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.373458 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.376320 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.376321 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.376322 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.376329 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.378654 (+ 2325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.379116 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.379117 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.379117 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.379188 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.379579 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.379580 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.379580 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.379738 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.379926 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.379972 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.380063 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:07:44.380393 11530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.368564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49230)
0808 05:07:44.368613 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.368623 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:44.368656 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:44.368931 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:44.368932 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:44.369117 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:44.369162 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.369164 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.370783 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.370785 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.371476 (+ 691us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.371497 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.374673 (+ 3176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.374674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.374736 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.375254 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:44.375259 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:44.376805 (+ 1546us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:44.378976 (+ 2171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.378977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.378978 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.379228 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.379426 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.379427 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.379427 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.379501 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.380094 (+ 593us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:44.380095 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:44.380141 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 05:07:44.380202 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 05:07:44.380293 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:07:44.380812 11758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.368617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49230 (local address 127.11.70.252:46171)
0808 05:07:44.368807 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.368809 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.368817 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:07:44.368836 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.368836 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.368847 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.368920 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.369261 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.370702 (+ 1441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.371566 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.374529 (+ 2963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.374622 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.376928 (+ 2306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.376930 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.376930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.376938 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.378837 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.379294 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.379295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.379295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.379357 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.379565 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.379566 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.379566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.379996 (+ 430us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.380052 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.380603 (+ 551us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.380695 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":100,"threads_started":1}
W20260808 05:07:44.381556 11779 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:07:44.381608 11779 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:44.381968 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:44.382856 11528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a: Bootstrap starting.
I20260808 05:07:44.380185 11656 master_runner.cc:186] Error getting master registration for 127.11.70.254:34677: OK, instance_id { permanent_uuid: "b359954511a74024aeca94d007489a0a" instance_seqno: 1786165664023366 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:07:44.382998 11656 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:07:44.383687 11528 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:44.384053 11528 log.cc:824] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:44.383117 11484 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "b359954511a74024aeca94d007489a0a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53866
I20260808 05:07:44.384948 11528 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a: No bootstrap required, opened a new log
I20260808 05:07:44.385931 11528 raft_consensus.cc:348] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } }
I20260808 05:07:44.386073 11528 raft_consensus.cc:729] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b359954511a74024aeca94d007489a0a, State: Initialized, Role: FOLLOWER
I20260808 05:07:44.386189 11528 consensus_queue.cc:260] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } }
I20260808 05:07:44.386519 11782 sys_catalog.cc:455] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.386582 11528 sys_catalog.cc:564] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:44.386619 11484 raft_consensus.cc:482] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 05:07:44.386628 11782 sys_catalog.cc:458] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:44.386711 11484 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:44.387604 11484 raft_consensus.cc:504] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } }
I20260808 05:07:44.388358 11484 leader_election.cc:288] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [CANDIDATE]: Term 1 election: Requested vote from peers 75cc1d12d6e049028d6436f02101d324 (127.11.70.253:38683), 7f0d618bfbc546138a8a10b27c6a8ea3 (127.11.70.252:46171)
W20260808 05:07:44.388407 11797 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:07:44.388458 11797 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:44.388701 11714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b359954511a74024aeca94d007489a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3"
I20260808 05:07:44.388834 11714 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:44.389868 11714 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b359954511a74024aeca94d007489a0a in term 1.
I20260808 05:07:44.390105 11445 leader_election.cc:302] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f0d618bfbc546138a8a10b27c6a8ea3, b359954511a74024aeca94d007489a0a; no voters:
I20260808 05:07:44.389570 11427 master_runner.cc:186] Error getting master registration for 127.11.70.253:38683: OK, instance_id { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" instance_seqno: 1786165664181238 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:07:44.391938 11427 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:07:44.392004 11782 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:44.392187 11782 raft_consensus.cc:686] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [term 1 LEADER]: Becoming Leader. State: Replica: b359954511a74024aeca94d007489a0a, State: Running, Role: LEADER
I20260808 05:07:44.392287 11782 consensus_queue.cc:237] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } }
I20260808 05:07:44.394538 11810 sys_catalog.cc:455] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [sys.catalog]: SysCatalogTable state changed. Reason: New leader b359954511a74024aeca94d007489a0a. Latest consensus state: current_term: 1 leader_uuid: "b359954511a74024aeca94d007489a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.394735 11810 sys_catalog.cc:458] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:44.407289 11758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.391464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49236 (local address 127.11.70.252:46171)
0808 05:07:44.392788 (+ 1324us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.392790 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.398908 (+ 6118us) server_negotiation.cc:407] Connection header received
0808 05:07:44.399010 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.399011 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.399025 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.399063 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.399878 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.400711 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.401844 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.402194 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.402239 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.403929 (+ 1690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.403930 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.403930 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.403938 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.405838 (+ 1900us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.406249 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.406250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.406251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.406321 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.406566 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.406567 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.406567 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.406700 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.406830 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.407059 (+ 229us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.407150 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1300}
I20260808 05:07:44.408190 11533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.392926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53878 (local address 127.11.70.254:34677)
0808 05:07:44.392988 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.392990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.394831 (+ 1841us) server_negotiation.cc:407] Connection header received
0808 05:07:44.394963 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.394964 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.394975 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.395012 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.395926 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.396738 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.397904 (+ 1166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.398225 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.398276 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.402944 (+ 4668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.402957 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.402957 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.402965 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.404965 (+ 2000us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.406251 (+ 1286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.406253 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.406253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.406326 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.406999 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.407000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.407001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.407166 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.407243 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.407994 (+ 751us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.408082 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:07:44.410609 11816 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:44.410882 11816 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:44.414753 11652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.392828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46258 (local address 127.11.70.253:38683)
0808 05:07:44.392871 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.392872 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.398963 (+ 6091us) server_negotiation.cc:407] Connection header received
0808 05:07:44.398995 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.398996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.399008 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.399069 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.401465 (+ 2396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.402208 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.408350 (+ 6142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.409357 (+ 1007us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.409441 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.411336 (+ 1895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.411338 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.411338 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.411347 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.413115 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.413519 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.413520 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.413520 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.413604 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.413927 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.413928 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.413928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.414068 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.414155 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.414561 (+ 406us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.414655 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:07:44.416116 11714 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [term 1 FOLLOWER]: Refusing update from remote peer b359954511a74024aeca94d007489a0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:44.416544 11810 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:44.417874 11644 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } attempt: 3
I20260808 05:07:44.418037 11760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b359954511a74024aeca94d007489a0a. Latest consensus state: current_term: 1 leader_uuid: "b359954511a74024aeca94d007489a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.418160 11760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [sys.catalog]: This master's current role is: FOLLOWER
Aug 08 05:07:44 dist-test-slave-7kzw krb5kdc[11410](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165664, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:07:44.427158 11648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.418352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:46171 (local address 127.0.0.1:49240)
0808 05:07:44.418457 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:44.418509 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:44.418575 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:44.418770 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:44.418772 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:44.418949 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:44.418998 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.419000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.420009 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.420011 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.420860 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:44.420862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.421860 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.421861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:44.421926 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.422381 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:44.422386 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:44.423967 (+ 1581us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:44.426001 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.426002 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.426003 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.426217 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.426453 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:44.426454 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:44.426454 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:44.426536 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:44.426860 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:44.426861 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:44.426906 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:07:44.426960 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:07:44.427056 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260808 05:07:44.427999 11758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:44.418413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49240 (local address 127.11.70.252:46171)
0808 05:07:44.418503 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.418505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.418557 (+ 52us) server_negotiation.cc:407] Connection header received
0808 05:07:44.418669 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.418670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.418681 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.418752 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.419101 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.419898 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.420957 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:44.421272 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:44.421331 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:44.424063 (+ 2732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:44.424064 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:44.424064 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:44.424071 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:44.425907 (+ 1836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.426313 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.426314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.426315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.426386 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:44.426613 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:44.426614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:44.426614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:44.426772 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:44.426832 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:44.427800 (+ 968us) server_negotiation.cc:299] Negotiation successful
0808 05:07:44.427897 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:07:44.430130 11644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324: Bootstrap starting.
I20260808 05:07:44.431061 11810 sys_catalog.cc:455] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b359954511a74024aeca94d007489a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.431176 11810 sys_catalog.cc:458] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:44.431689 11760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b359954511a74024aeca94d007489a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.431780 11760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:44.431964 11816 catalog_manager.cc:1347] Generated new cluster ID: 63703bc6a2034758a2104df2fb6375ed
I20260808 05:07:44.432025 11816 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:44.432552 11644 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:44.432845 11644 log.cc:824] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:44.433104 11818 mvcc.cc:205] Tried to move back new op lower bound from 7316134561437069312 to 7316134561351536640. Current Snapshot: MvccSnapshot[applied={T|T < 7316134561437069312 or (T in {7316134561437069312})}]
I20260808 05:07:44.433295 11821 mvcc.cc:205] Tried to move back new op lower bound from 7316134561437069312 to 7316134561351536640. Current Snapshot: MvccSnapshot[applied={T|T < 7316134561437069312}]
I20260808 05:07:44.434180 11644 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324: No bootstrap required, opened a new log
I20260808 05:07:44.436074 11644 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } }
I20260808 05:07:44.436209 11644 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75cc1d12d6e049028d6436f02101d324, State: Initialized, Role: FOLLOWER
I20260808 05:07:44.436273 11644 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } }
I20260808 05:07:44.436578 11644 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:44.436641 11609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b359954511a74024aeca94d007489a0a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "75cc1d12d6e049028d6436f02101d324"
I20260808 05:07:44.436767 11609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:44.437711 11609 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b359954511a74024aeca94d007489a0a in term 1.
I20260808 05:07:44.437937 11608 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [term 1 FOLLOWER]: Refusing update from remote peer b359954511a74024aeca94d007489a0a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:44.438382 11782 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [LEADER]: Connected to new peer: Peer: permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:44.440577 11851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b359954511a74024aeca94d007489a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.440377 11848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b359954511a74024aeca94d007489a0a. Latest consensus state: current_term: 1 leader_uuid: "b359954511a74024aeca94d007489a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.440744 11848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:44.440877 11851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:44.440963 11828 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.441078 11828 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:44.447685 11846 catalog_manager.cc:1259] Loaded cluster ID: 63703bc6a2034758a2104df2fb6375ed
I20260808 05:07:44.448055 11846 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324: loading cluster ID for follower catalog manager: success
W20260808 05:07:44.448235 11846 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260808 05:07:44.448328 11846 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:44.467561 11782 sys_catalog.cc:455] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b359954511a74024aeca94d007489a0a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b359954511a74024aeca94d007489a0a" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 34677 } } peers { permanent_uuid: "75cc1d12d6e049028d6436f02101d324" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 38683 } } peers { permanent_uuid: "7f0d618bfbc546138a8a10b27c6a8ea3" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 46171 } } }
I20260808 05:07:44.467700 11782 sys_catalog.cc:458] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:44.470376 11816 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:44.471140 11816 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:44.479211 11816 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b359954511a74024aeca94d007489a0a: Generated new TSK 0
I20260808 05:07:44.479398 11816 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:07:44.502280 11533 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.500750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53880 (local address 127.11.70.254:34677)
0808 05:07:44.500803 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.500805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.501505 (+ 700us) server_negotiation.cc:407] Connection header received
0808 05:07:44.501637 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.501639 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.501653 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.501690 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.502197 (+ 507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53880: BlockingRecv error: recv got EOF from 127.0.0.1:53880 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 05:07:44.503170 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.501220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46272 (local address 127.11.70.253:38683)
0808 05:07:44.501265 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.501267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.502568 (+ 1301us) server_negotiation.cc:407] Connection header received
0808 05:07:44.502705 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.502706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.502718 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.502752 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.503100 (+ 348us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46272: BlockingRecv error: recv got EOF from 127.0.0.1:46272 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 05:07:44.504400 11758 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.503569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49250 (local address 127.11.70.252:46171)
0808 05:07:44.503623 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.503625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.503750 (+ 125us) server_negotiation.cc:407] Connection header received
0808 05:07:44.503849 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.503851 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.503861 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.503894 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.504333 (+ 439us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49250: BlockingRecv error: recv got EOF from 127.0.0.1:49250 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 05:07:44.507038 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.506167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46278 (local address 127.11.70.253:38683)
0808 05:07:44.506205 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.506207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.506409 (+ 202us) server_negotiation.cc:407] Connection header received
0808 05:07:44.506569 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.506570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.506592 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.506641 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.506987 (+ 346us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46278: BlockingRecv error: recv got EOF from 127.0.0.1:46278 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 05:07:44.510216 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.509406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46290 (local address 127.11.70.253:38683)
0808 05:07:44.509440 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.509442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.509704 (+ 262us) server_negotiation.cc:407] Connection header received
0808 05:07:44.509806 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.509807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.509819 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.509850 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.510169 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46290: BlockingRecv error: recv got EOF from 127.0.0.1:46290 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 05:07:44.514245 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.513444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46292 (local address 127.11.70.253:38683)
0808 05:07:44.513480 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.513482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.513725 (+ 243us) server_negotiation.cc:407] Connection header received
0808 05:07:44.513828 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.513829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.513840 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.513871 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.514195 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46292: BlockingRecv error: recv got EOF from 127.0.0.1:46292 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 05:07:44.520335 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.519441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46306 (local address 127.11.70.253:38683)
0808 05:07:44.519478 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.519479 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.519779 (+ 300us) server_negotiation.cc:407] Connection header received
0808 05:07:44.519887 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.519888 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.519899 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.519931 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.520273 (+ 342us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46306: BlockingRecv error: recv got EOF from 127.0.0.1:46306 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 05:07:44.530577 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.529614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46318 (local address 127.11.70.253:38683)
0808 05:07:44.529657 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.529658 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.529915 (+ 257us) server_negotiation.cc:407] Connection header received
0808 05:07:44.530024 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.530025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.530037 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.530071 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.530450 (+ 379us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46318: BlockingRecv error: recv got EOF from 127.0.0.1:46318 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 05:07:44.549376 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.548321 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46324 (local address 127.11.70.253:38683)
0808 05:07:44.548367 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.548370 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.548688 (+ 318us) server_negotiation.cc:407] Connection header received
0808 05:07:44.548811 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.548813 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.548827 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.548862 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.549302 (+ 440us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46324: BlockingRecv error: recv got EOF from 127.0.0.1:46324 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 05:07:44.584085 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.583018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46332 (local address 127.11.70.253:38683)
0808 05:07:44.583072 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.583074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.583390 (+ 316us) server_negotiation.cc:407] Connection header received
0808 05:07:44.583510 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.583511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.583525 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.583559 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.584016 (+ 457us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46332: BlockingRecv error: recv got EOF from 127.0.0.1:46332 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 05:07:44.650430 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.649654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46344 (local address 127.11.70.253:38683)
0808 05:07:44.649751 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.649752 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.649821 (+ 69us) server_negotiation.cc:407] Connection header received
0808 05:07:44.649864 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.649865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.649876 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.649943 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.650360 (+ 417us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46344: BlockingRecv error: recv got EOF from 127.0.0.1:46344 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
W20260808 05:07:44.780488 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:44.779670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46356 (local address 127.11.70.253:38683)
0808 05:07:44.779767 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:44.779769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:44.779896 (+ 127us) server_negotiation.cc:407] Connection header received
0808 05:07:44.779977 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:44.779978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:44.779992 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:44.780041 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:44.780416 (+ 375us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46356: BlockingRecv error: recv got EOF from 127.0.0.1:46356 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260808 05:07:45.038878 11652 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:45.038059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46360 (local address 127.11.70.253:38683)
0808 05:07:45.038124 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:45.038126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:45.038142 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:07:45.038246 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:45.038248 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:45.038261 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:45.038350 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:45.038795 (+ 445us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46360: BlockingRecv error: recv got EOF from 127.0.0.1:46360 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 05:07:45.382105 11779 catalog_manager.cc:1259] Loaded cluster ID: 63703bc6a2034758a2104df2fb6375ed
I20260808 05:07:45.382232 11779 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3: loading cluster ID for follower catalog manager: success
I20260808 05:07:45.383100 11779 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3: acquiring CA information for follower catalog manager: success
I20260808 05:07:45.383436 11779 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7f0d618bfbc546138a8a10b27c6a8ea3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:07:45.449618 11846 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324: acquiring CA information for follower catalog manager: success
I20260808 05:07:45.449960 11846 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 75cc1d12d6e049028d6436f02101d324: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:07:45.555518 11942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:45.552369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46370 (local address 127.11.70.253:38683)
0808 05:07:45.552608 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:45.552610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:45.552622 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:07:45.552650 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:45.552651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:45.552709 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:45.552800 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:45.553057 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.553619 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.554687 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.554889 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.554956 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:45.555177 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:45.555294 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:45.555363 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:45.555425 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 05:07:45.555445 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":181,"threads_started":1}
I20260808 05:07:45.560922 11949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:45.557899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49264 (local address 127.11.70.252:46171)
0808 05:07:45.558039 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:45.558043 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:45.558058 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:07:45.558110 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:45.558111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:45.558149 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:45.558254 (+ 105us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:45.558418 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.559087 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.559920 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.560162 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.560234 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:45.560443 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:45.560551 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:45.560625 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:45.560831 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 05:07:45.560852 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260808 05:07:45.565968 11942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:45.562903 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46372 (local address 127.11.70.253:38683)
0808 05:07:45.563027 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:45.563029 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:45.563238 (+ 209us) server_negotiation.cc:407] Connection header received
0808 05:07:45.563347 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:45.563348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:45.563360 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:45.563392 (+ 32us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:45.563592 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.564328 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.565143 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.565406 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.565471 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:45.565633 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:45.565670 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:45.565721 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:45.565838 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 05:07:45.565865 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260808 05:07:45.566201 11949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:45.562947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49274 (local address 127.11.70.252:46171)
0808 05:07:45.562991 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:45.562993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:45.563200 (+ 207us) server_negotiation.cc:407] Connection header received
0808 05:07:45.563238 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:45.563239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:45.563251 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:45.563307 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:45.563452 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.564219 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.565346 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.565629 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.565699 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:45.565853 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:45.565884 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:45.565913 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:45.566114 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 05:07:45.566140 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:07:45.566443 11958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:45.562894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53882 (local address 127.11.70.254:34677)
0808 05:07:45.563013 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:45.563015 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:45.563024 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:45.563146 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:45.563148 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:45.563205 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:45.563281 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:45.563397 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.564152 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.565388 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:45.565696 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:45.565759 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:45.565959 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:45.566079 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:45.566155 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:45.566313 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 05:07:45.566344 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":61,"threads_started":1}
I20260808 05:07:45.568564 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 11427
I20260808 05:07:45.589408 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 11538
I20260808 05:07:45.599200 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 11656
2026-08-08T05:07:45Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3058 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:45 dist-test-slave-7kzw krb5kdc[11963](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:45 dist-test-slave-7kzw krb5kdc[11963](info): set up 2 sockets
Aug 08 05:07:45 dist-test-slave-7kzw krb5kdc[11963](info): commencing operation
krb5kdc: starting...
W20260808 05:07:46.859565 11547 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/test-user.keytab.
Aug 08 05:07:46 dist-test-slave-7kzw krb5kdc[11963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.11.70.254@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.254@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
Entry for principal kudu/127.11.70.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab.
I20260808 05:07:46.994191 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:45209
--webserver_interface=127.11.70.254
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:45209,127.11.70.253:33703,127.11.70.252:33699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:47.083920 11981 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:07:47.084213 11981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:47.084247 11981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:47.084295 11981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:47.085558 11981 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:47.085650 11981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:47.085681 11981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:47.085718 11981 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:47.085747 11981 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:47.087431 11981 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:45209,127.11.70.253:33703,127.11.70.252:33699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.254.keytab
--principal=kudu/127.11.70.254
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.254:45209
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.11.70.254
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:47.087764 11981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:47.088032 11981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:47.093683 11987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:47.093741 11989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:47.093720 11986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:47.093897 11981 server_base.cc:1034] running on GCE node
I20260808 05:07:47.094197 11981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:47.094689 11981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:47.095890 11981 hybrid_clock.cc:648] HybridClock initialized: now 1786165667095874 us; error 31 us; skew 500 ppm
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:47.098815 11981 init.cc:377] Logged in from keytab as kudu/127.11.70.254@KRBTEST.COM (short username kudu)
I20260808 05:07:47.099383 11981 webserver.cc:460] Webserver started at http://127.11.70.254:42997/ using document root <none> and password file <none>
I20260808 05:07:47.099651 11981 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:47.099731 11981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:47.099903 11981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:47.101115 11981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/data/instance:
uuid: "bcd50d8ba60b45ccb3955a120949efec"
format_stamp: "Formatted at 2026-08-08 05:07:47 on dist-test-slave-7kzw"
server_key: "4b84b8395183e0b1d6272b1897510deb"
server_key_iv: "a7ef1a6bbeb7d7e2ee5d5b3e30301353"
server_key_version: "encryptionkey@0"
I20260808 05:07:47.101536 11981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/wal/instance:
uuid: "bcd50d8ba60b45ccb3955a120949efec"
format_stamp: "Formatted at 2026-08-08 05:07:47 on dist-test-slave-7kzw"
server_key: "4b84b8395183e0b1d6272b1897510deb"
server_key_iv: "a7ef1a6bbeb7d7e2ee5d5b3e30301353"
server_key_version: "encryptionkey@0"
I20260808 05:07:47.103160 11981 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:47.104213 11999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:47.104471 11981 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:07:47.104635 11981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/wal
uuid: "bcd50d8ba60b45ccb3955a120949efec"
format_stamp: "Formatted at 2026-08-08 05:07:47 on dist-test-slave-7kzw"
server_key: "4b84b8395183e0b1d6272b1897510deb"
server_key_iv: "a7ef1a6bbeb7d7e2ee5d5b3e30301353"
server_key_version: "encryptionkey@0"
I20260808 05:07:47.104779 11981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:47.117453 11981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:47.120246 11981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:47.120440 11981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:47.125409 11981 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.254:45209
I20260808 05:07:47.125473 12070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.254:45209 every 8 connection(s)
I20260808 05:07:47.125909 11981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:47.127208 12071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:47.128997 12071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:47.130621 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 11981
I20260808 05:07:47.130750 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-0/wal/instance
I20260808 05:07:47.130986 11547 external_mini_cluster.cc:1428] Setting key 61ae92137ba9ca9bfc0d0132bd7b27c1
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
WARNING: no policy specified for kudu/127.11.70.253@KRBTEST.COM; defaulting to no policy
I20260808 05:07:47.140564 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.129809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:45209 (local address 127.0.0.1:58710)
0808 05:07:47.130009 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.130087 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:47.130748 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:47.131261 (+ 513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:47.131265 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:47.131674 (+ 409us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:47.131932 (+ 258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.131939 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.133110 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.133111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.133890 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.133893 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.134547 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.134549 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.134623 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.135252 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:47.135261 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:47.136851 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:47.138949 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.138957 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.138959 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.139183 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.139476 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.139477 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.139477 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.139582 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.139984 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:47.139990 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:47.140061 (+ 71us) client_negotiation.cc:769] Sending connection context
0808 05:07:47.140190 (+ 129us) client_negotiation.cc:240] Negotiation successful
0808 05:07:47.140348 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":83,"threads_started":1}
I20260808 05:07:47.140573 12074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.129889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58710 (local address 127.11.70.254:45209)
0808 05:07:47.130128 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.130131 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.130180 (+ 49us) server_negotiation.cc:407] Connection header received
0808 05:07:47.130985 (+ 805us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.130988 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.131025 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.131134 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.132060 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.132983 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.134009 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.134382 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.134580 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.136965 (+ 2385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.136974 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.136975 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.136982 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.138838 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.139298 (+ 460us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.139301 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.139302 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.139396 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.139658 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.139659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.139660 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.139902 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.140008 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.140321 (+ 313us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.140433 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":128,"threads_started":1}
I20260808 05:07:47.141508 12071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:47.141918 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.141795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:33703 (local address 127.0.0.1:36444)
0808 05:07:47.141849 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.141898 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260808 05:07:47.142086 12006 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
I20260808 05:07:47.142599 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.142485 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:33703 (local address 127.0.0.1:36452)
0808 05:07:47.142552 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.142580 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
W20260808 05:07:47.142813 12071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.253:33703: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.253@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab.
Entry for principal kudu/127.11.70.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab.
I20260808 05:07:47.161300 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.253:33703
--webserver_interface=127.11.70.253
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab
--principal=kudu/127.11.70.253
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:45209,127.11.70.253:33703,127.11.70.252:33699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:07:47.192096 12071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } attempt: 1
I20260808 05:07:47.192741 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.192559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:33703 (local address 127.0.0.1:36462)
0808 05:07:47.192657 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.192705 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260808 05:07:47.193264 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.193114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:33703 (local address 127.0.0.1:36468)
0808 05:07:47.193194 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.193232 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260808 05:07:47.193446 12071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.253:33703: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
W20260808 05:07:47.250036 12082 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:07:47.250268 12082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:47.250288 12082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:47.250383 12082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:47.251545 12082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:47.251590 12082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:47.251603 12082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:47.251616 12082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:47.251665 12082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:47.253137 12082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:45209,127.11.70.253:33703,127.11.70.252:33699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.253.keytab
--principal=kudu/127.11.70.253
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.253:33703
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.11.70.253
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:47.253410 12082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:47.253650 12082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:47.258809 12087 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:47.258795 12092 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:47.258872 12089 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:47.259044 12082 server_base.cc:1034] running on GCE node
I20260808 05:07:47.259338 12082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:47.259688 12082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:47.260877 12082 hybrid_clock.cc:648] HybridClock initialized: now 1786165667260920 us; error 87 us; skew 500 ppm
I20260808 05:07:47.261627 12071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } attempt: 2
I20260808 05:07:47.262054 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.261917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:33703 (local address 127.0.0.1:36484)
0808 05:07:47.261986 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.262022 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 05:07:47.262535 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.262352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:33703 (local address 127.0.0.1:36488)
0808 05:07:47.262421 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.262458 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260808 05:07:47.262706 12071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.253:33703: Network error: Client connection negotiation failed: client connection to 127.11.70.253:33703: connect: Connection refused (error 111)
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:47.263827 12082 init.cc:377] Logged in from keytab as kudu/127.11.70.253@KRBTEST.COM (short username kudu)
I20260808 05:07:47.264256 12082 webserver.cc:460] Webserver started at http://127.11.70.253:43279/ using document root <none> and password file <none>
I20260808 05:07:47.264487 12082 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:47.264557 12082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:47.264724 12082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:47.265861 12082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/data/instance:
uuid: "a91262efe3414fb0b4aaba7a8afcc64d"
format_stamp: "Formatted at 2026-08-08 05:07:47 on dist-test-slave-7kzw"
server_key: "7324f94847ddf950d2d51672bad24090"
server_key_iv: "27cccf7b90e381a36905580f4487b993"
server_key_version: "encryptionkey@0"
I20260808 05:07:47.266232 12082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/wal/instance:
uuid: "a91262efe3414fb0b4aaba7a8afcc64d"
format_stamp: "Formatted at 2026-08-08 05:07:47 on dist-test-slave-7kzw"
server_key: "7324f94847ddf950d2d51672bad24090"
server_key_iv: "27cccf7b90e381a36905580f4487b993"
server_key_version: "encryptionkey@0"
I20260808 05:07:47.267838 12082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:47.268656 12103 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:47.268846 12082 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:47.268951 12082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/wal
uuid: "a91262efe3414fb0b4aaba7a8afcc64d"
format_stamp: "Formatted at 2026-08-08 05:07:47 on dist-test-slave-7kzw"
server_key: "7324f94847ddf950d2d51672bad24090"
server_key_iv: "27cccf7b90e381a36905580f4487b993"
server_key_version: "encryptionkey@0"
I20260808 05:07:47.269034 12082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:47.283233 12082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:47.285305 12082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:47.285475 12082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:47.289940 12082 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.253:33703
I20260808 05:07:47.289985 12173 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.253:33703 every 8 connection(s)
I20260808 05:07:47.290364 12082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/data/info.pb
I20260808 05:07:47.291450 12176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:47.292986 12176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:47.297451 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 12082
I20260808 05:07:47.297586 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-1/wal/instance
I20260808 05:07:47.297801 11547 external_mini_cluster.cc:1428] Setting key 590ed3626df7d37af8ff3c5890f86aba
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:47.302835 12074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.293714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58716 (local address 127.11.70.254:45209)
0808 05:07:47.293792 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.293795 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.294033 (+ 238us) server_negotiation.cc:407] Connection header received
0808 05:07:47.294572 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.294574 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.294591 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.294671 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.295323 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.295868 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.296937 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.297284 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.297367 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.299764 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.299766 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.299766 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.299774 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.301295 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.301748 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.301750 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.301750 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.301820 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.302095 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.302096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.302096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.302219 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.302298 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.302649 (+ 351us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.302741 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:07:47.303085 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.293682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:45209 (local address 127.0.0.1:58716)
0808 05:07:47.293901 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.293940 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:47.294433 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:47.294732 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:47.294736 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:47.295005 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:47.295213 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.295217 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.295982 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.295983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.296842 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.296845 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.297396 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.297397 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.297507 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.298162 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:47.298172 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:47.299646 (+ 1474us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:47.301404 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.301413 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.301415 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.301652 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.301899 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.301900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.301900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.302017 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.302289 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:47.302297 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:47.302446 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 05:07:47.302614 (+ 168us) client_negotiation.cc:240] Negotiation successful
0808 05:07:47.302793 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":124,"threads_started":1}
I20260808 05:07:47.303715 12176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.11.70.252@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.11.70.252@KRBTEST.COM" created.
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:07:47.314457 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.304105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36496 (local address 127.11.70.253:33703)
0808 05:07:47.304265 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.304269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.304284 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:07:47.304299 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.304301 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.304310 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.304395 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.304674 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.305358 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.306036 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.306363 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.306459 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.311332 (+ 4873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.311344 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.311344 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.311353 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.313112 (+ 1759us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.313543 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.313545 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.313546 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.313602 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.313820 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.313821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.313821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.313962 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.314025 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.314214 (+ 189us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.314348 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":133,"thread_start_us":109,"threads_started":1}
I20260808 05:07:47.314590 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.304050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:33703 (local address 127.0.0.1:36496)
0808 05:07:47.304103 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.304114 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:47.304158 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:47.304395 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:47.304396 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:47.304544 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:47.304587 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.304589 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.305460 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.305462 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.305955 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.305956 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.306488 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.306489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.306556 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.307006 (+ 450us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:47.307011 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:47.311232 (+ 4221us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:47.313204 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.313205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.313206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.313449 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.313674 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.313675 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.313675 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.313754 (+ 79us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.314031 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:47.314032 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:47.314099 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 05:07:47.314176 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 05:07:47.314296 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 05:07:47.315266 12176 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:47.315670 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.315523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55432)
0808 05:07:47.315577 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.315637 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 05:07:47.315809 12106 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
I20260808 05:07:47.316239 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.316144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55446)
0808 05:07:47.316193 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.316220 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 05:07:47.316393 12176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:33699: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.11.70.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab.
Entry for principal kudu/127.11.70.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab.
I20260808 05:07:47.327692 11547 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
/tmp/dist-test-taskJXTM0Z/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.252:33699
--webserver_interface=127.11.70.252
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab
--principal=kudu/127.11.70.252
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.11.70.212:42207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.11.70.254:45209,127.11.70.253:33703,127.11.70.252:33699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:07:47.353871 12071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } attempt: 3
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:07:47.361557 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.354263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:33703 (local address 127.0.0.1:36512)
0808 05:07:47.354343 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.354360 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:47.354425 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:47.354627 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:47.354628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:47.354826 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:47.354908 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.354910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.355583 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.355584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.356432 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.356434 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.356818 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.356820 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.356902 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.357379 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:47.357385 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:47.358827 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:47.360447 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.360448 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.360449 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.360631 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.360846 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.360847 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.360847 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.360915 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.361178 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:47.361179 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:47.361226 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 05:07:47.361311 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 05:07:47.361436 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 05:07:47.361560 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.354356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36512 (local address 127.11.70.253:33703)
0808 05:07:47.354420 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.354422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.354440 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:07:47.354528 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.354529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.354542 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.354600 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.354994 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.355477 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.356517 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.356727 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.356799 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.358923 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.358925 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.358926 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.358936 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.360351 (+ 1415us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.360709 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.360711 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.360711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.360774 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.360984 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.360985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.360985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.361101 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.361174 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.361352 (+ 178us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.361438 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:07:47.361975 12071 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:47.362346 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.362235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55452)
0808 05:07:47.362287 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.362315 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 05:07:47.362756 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.362689 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55460)
0808 05:07:47.362715 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.362739 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260808 05:07:47.362860 12071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:33699: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
I20260808 05:07:47.365633 12176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } attempt: 1
I20260808 05:07:47.366044 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.365930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55464)
0808 05:07:47.365990 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.366020 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 05:07:47.366387 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.366328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55480)
0808 05:07:47.366352 (+ 24us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.366372 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260808 05:07:47.366518 12176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:33699: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
I20260808 05:07:47.394001 12071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } attempt: 1
I20260808 05:07:47.394665 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.394367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55486)
0808 05:07:47.394446 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.394524 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260808 05:07:47.395215 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.395098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55492)
0808 05:07:47.395151 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.395185 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260808 05:07:47.395339 12071 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:33699: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
W20260808 05:07:47.412995 12191 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:07:47.413211 12191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:47.413228 12191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:47.413249 12191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:47.414296 12191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:47.414328 12191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:47.414342 12191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:47.414355 12191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:47.414367 12191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:47.415848 12191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.11.70.212:42207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.11.70.254:45209,127.11.70.253:33703,127.11.70.252:33699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/krb5kdc/kudu_127.11.70.252.keytab
--principal=kudu/127.11.70.252
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.11.70.252:33699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.11.70.252
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12191
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:47.416044 12191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:47.416220 12191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:47.421265 12197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:47.421288 12199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:47.421305 12204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:47.421545 12191 server_base.cc:1034] running on GCE node
I20260808 05:07:47.421823 12191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:47.422169 12191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:47.423339 12191 hybrid_clock.cc:648] HybridClock initialized: now 1786165667423338 us; error 56 us; skew 500 ppm
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:47.425812 12191 init.cc:377] Logged in from keytab as kudu/127.11.70.252@KRBTEST.COM (short username kudu)
I20260808 05:07:47.426259 12191 webserver.cc:460] Webserver started at http://127.11.70.252:40059/ using document root <none> and password file <none>
I20260808 05:07:47.426548 12191 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:47.426599 12191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:47.426749 12191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:47.427871 12191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/data/instance:
uuid: "461db43bb96a4fa2aed74d2cc3bc59f2"
format_stamp: "Formatted at 2026-08-08 05:07:47 on dist-test-slave-7kzw"
server_key: "5f04b51264d208bd4e637e2219727821"
server_key_iv: "1bde159359d6d211aed94e42d0ed138b"
server_key_version: "encryptionkey@0"
I20260808 05:07:47.428248 12191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/wal/instance:
uuid: "461db43bb96a4fa2aed74d2cc3bc59f2"
format_stamp: "Formatted at 2026-08-08 05:07:47 on dist-test-slave-7kzw"
server_key: "5f04b51264d208bd4e637e2219727821"
server_key_iv: "1bde159359d6d211aed94e42d0ed138b"
server_key_version: "encryptionkey@0"
I20260808 05:07:47.429636 12191 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:07:47.430527 12211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:47.430809 12191 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:47.430898 12191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/data,/tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/wal
uuid: "461db43bb96a4fa2aed74d2cc3bc59f2"
format_stamp: "Formatted at 2026-08-08 05:07:47 on dist-test-slave-7kzw"
server_key: "5f04b51264d208bd4e637e2219727821"
server_key_iv: "1bde159359d6d211aed94e42d0ed138b"
server_key_version: "encryptionkey@0"
I20260808 05:07:47.431005 12191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:47.434752 12176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } attempt: 2
I20260808 05:07:47.435189 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.435051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55502)
0808 05:07:47.435113 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.435148 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 05:07:47.435556 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.435443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55510)
0808 05:07:47.435503 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.435529 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 05:07:47.435663 12176 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.70.252:33699: Network error: Client connection negotiation failed: client connection to 127.11.70.252:33699: connect: Connection refused (error 111)
I20260808 05:07:47.439109 12191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:47.441095 12191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:47.441262 12191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:47.445233 12191 rpc_server.cc:307] RPC server started. Bound to: 127.11.70.252:33699
I20260808 05:07:47.445288 12278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.70.252:33699 every 8 connection(s)
I20260808 05:07:47.445643 12191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/data/info.pb
I20260808 05:07:47.446717 12282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:47.448284 12282 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:07:47.452800 11547 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu as pid 12191
I20260808 05:07:47.452924 11547 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJXTM0Z/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165386228479-11547-0/minicluster-data/master-2/wal/instance
I20260808 05:07:47.453135 11547 external_mini_cluster.cc:1428] Setting key 752e9f384ef82297644954083358520b
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:47.457993 12074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.448984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58718 (local address 127.11.70.254:45209)
0808 05:07:47.449072 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.449074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.449260 (+ 186us) server_negotiation.cc:407] Connection header received
0808 05:07:47.449774 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.449775 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.449789 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.449844 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.450457 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.450958 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.451932 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.452129 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.452211 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.454885 (+ 2674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.454887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.454888 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.454896 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.456366 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.456798 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.456800 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.456800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.456893 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.457275 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.457276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.457277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.457406 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.457478 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.457839 (+ 361us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.457912 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:07:47.458238 12285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.448939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.254:45209 (local address 127.0.0.1:58718)
0808 05:07:47.449144 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.449178 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:47.449650 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:47.449928 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:47.449931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:47.450175 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:47.450355 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.450359 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.451059 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.451060 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.451826 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.451828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.452230 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.452231 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.452358 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.452848 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:47.452856 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:47.454796 (+ 1940us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:47.456474 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.456481 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.456483 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.456716 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.456968 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.456969 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.456969 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.457150 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.457493 (+ 343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:47.457502 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:47.457677 (+ 175us) client_negotiation.cc:769] Sending connection context
0808 05:07:47.457813 (+ 136us) client_negotiation.cc:240] Negotiation successful
0808 05:07:47.457972 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":87,"threads_started":1}
I20260808 05:07:47.458966 12282 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:07:47.463291 12287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.453551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55520 (local address 127.11.70.252:33699)
0808 05:07:47.453723 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.453727 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.453760 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:07:47.453785 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.453787 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.453802 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.453867 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.454676 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.455490 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.456262 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.456560 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.456642 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.459591 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.459599 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.459600 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.459606 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.461385 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.462273 (+ 888us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.462276 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.462277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.462367 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.462664 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.462665 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.462665 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.462866 (+ 201us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.462993 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.463157 (+ 164us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.463218 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":78,"threads_started":1}
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:07:47.466997 12285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.459227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.253:33703 (local address 127.0.0.1:36526)
0808 05:07:47.459286 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.459297 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:47.459339 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:47.459496 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:47.459497 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:47.459652 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:47.459707 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.459709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.460595 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.460597 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.461392 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.461394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.461798 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.461799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.461851 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.462266 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:47.462271 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:47.464087 (+ 1816us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:47.465896 (+ 1809us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.465898 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.465898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.466138 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.466355 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.466356 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.466356 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.466432 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.466735 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:47.466736 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:47.466786 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 05:07:47.466864 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:07:47.466937 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 05:07:47.467073 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.459311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.11.70.253:33703)
0808 05:07:47.459375 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.459377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.459388 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:07:47.459414 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.459415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.459424 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.459484 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.459796 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.460501 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.461480 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.461723 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.461800 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.464173 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.464175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.464175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.464184 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.465796 (+ 1612us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.466224 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.466225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.466225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.466282 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.466548 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.466549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.466549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.466663 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.466715 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.466901 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.466979 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:07:47.467482 12282 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.254@KRBTEST.COM
I20260808 05:07:47.470767 12071 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } attempt: 2
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.252@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:07:47.473194 12074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.464250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58720 (local address 127.11.70.254:45209)
0808 05:07:47.464298 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.464300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.464309 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:47.464331 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.464332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.464343 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.464406 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.465033 (+ 627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.465762 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.466793 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.467054 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.467122 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.469700 (+ 2578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.469701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.469701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.469709 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.472004 (+ 2295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.472399 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.472400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.472401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.472467 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.472660 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.472661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.472661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.472792 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.472955 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.473019 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.473102 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:07:47.475821 12285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.467758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55536)
0808 05:07:47.467804 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.467813 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:47.467853 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:47.467981 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:47.467981 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:47.468102 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:47.468132 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.468133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.468962 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.468963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.469493 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.469495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.469874 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.469875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.469924 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.470369 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:47.470373 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:47.471672 (+ 1299us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:47.474771 (+ 3099us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.474772 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.474773 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.474939 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.475140 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.475141 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.475141 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.475209 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.475489 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:47.475489 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:47.475524 (+ 35us) client_negotiation.cc:769] Sending connection context
0808 05:07:47.475603 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:07:47.475700 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:07:47.475901 12287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.467818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55536 (local address 127.11.70.252:33699)
0808 05:07:47.467861 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.467863 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.467872 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:07:47.467896 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.467896 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.467907 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.467979 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.468208 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.468878 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.469572 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.469792 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.469863 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.471795 (+ 1932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.471797 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.471797 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.471804 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.474695 (+ 2891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.475026 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.475027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.475027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.475082 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.475276 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.475277 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.475277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.475390 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.475467 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.475636 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.475768 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":24}
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.254@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:07:47.477567 12282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2: Bootstrap starting.
I20260808 05:07:47.478345 12282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2: Neither blocks nor log segments found. Creating new log.
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165666, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.70.253@KRBTEST.COM
I20260808 05:07:47.478726 12282 log.cc:824] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:47.479626 12282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2: No bootstrap required, opened a new log
I20260808 05:07:47.481012 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.471081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55542 (local address 127.11.70.252:33699)
0808 05:07:47.471283 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.471285 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.471293 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:07:47.471312 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.471313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.471323 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.471431 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.471869 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.472692 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.474171 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.474966 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.475064 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.476945 (+ 1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.476947 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.476947 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.476955 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.479690 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.480130 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.480132 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.480132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.480199 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.480424 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.480425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.480426 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.480559 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.480639 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.480808 (+ 169us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.480883 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":308,"threads_started":1}
I20260808 05:07:47.480990 12073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.471022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55542)
0808 05:07:47.471068 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.471077 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:47.471125 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:47.471494 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:47.471496 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:47.471742 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:47.471788 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.471796 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.472761 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.472762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.474093 (+ 1331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.474095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.475072 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.475073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.475150 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.475539 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:47.475544 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:47.476854 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:47.479794 (+ 2940us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.479795 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.479796 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.480041 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.480264 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.480265 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.480265 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.480327 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.480633 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:47.480634 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:47.480681 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 05:07:47.480770 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:07:47.480872 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":23}
I20260808 05:07:47.481966 12282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } }
I20260808 05:07:47.482136 12282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 461db43bb96a4fa2aed74d2cc3bc59f2, State: Initialized, Role: FOLLOWER
I20260808 05:07:47.482211 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.473821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36540 (local address 127.11.70.253:33703)
0808 05:07:47.473866 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.473868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.473878 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:07:47.473903 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.473904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.473914 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.473983 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.474570 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.475308 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.476203 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.476526 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.476586 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.479122 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.479123 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.479124 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.479130 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.480869 (+ 1739us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.481402 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.481403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.481403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.481462 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.481662 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.481663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.481664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.481790 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.481946 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.482031 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.482117 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:07:47.482223 12282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } }
I20260808 05:07:47.482549 12282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:47.482517 12291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:47.482625 12291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:47.482877 12071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec: Bootstrap starting.
I20260808 05:07:47.483505 12071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:47.483832 12071 log.cc:824] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec: Log is configured to *not* fsync() on all Append() calls
W20260808 05:07:47.484354 12305 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:07:47.484405 12305 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:47.484676 12071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec: No bootstrap required, opened a new log
I20260808 05:07:47.486076 12071 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } }
I20260808 05:07:47.486222 12071 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcd50d8ba60b45ccb3955a120949efec, State: Initialized, Role: FOLLOWER
I20260808 05:07:47.486346 12071 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } }
I20260808 05:07:47.486694 12312 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:47.486845 12312 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:47.486763 12071 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:47.488265 11547 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:07:47.489204 12037 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "bcd50d8ba60b45ccb3955a120949efec"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58720
I20260808 05:07:47.489327 12037 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 05:07:47.489370 12037 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:47.490285 12037 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } }
I20260808 05:07:47.487986 12191 master_runner.cc:186] Error getting master registration for 127.11.70.254:45209: OK, instance_id { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" instance_seqno: 1786165667123951 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:07:47.490623 12191 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:07:47.490726 12037 leader_election.cc:288] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [CANDIDATE]: Term 1 election: Requested vote from peers a91262efe3414fb0b4aaba7a8afcc64d (127.11.70.253:33703), 461db43bb96a4fa2aed74d2cc3bc59f2 (127.11.70.252:33699)
I20260808 05:07:47.489580 11981 master_runner.cc:186] Error getting master registration for 127.11.70.253:33703: OK, instance_id { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" instance_seqno: 1786165667288634 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:07:47.492528 11981 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:07:47.492762 12244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bcd50d8ba60b45ccb3955a120949efec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2"
I20260808 05:07:47.492885 12244 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:47.494117 12244 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcd50d8ba60b45ccb3955a120949efec in term 1.
I20260808 05:07:47.494354 12004 leader_election.cc:302] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 461db43bb96a4fa2aed74d2cc3bc59f2, bcd50d8ba60b45ccb3955a120949efec; no voters:
I20260808 05:07:47.494540 12312 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:47.494709 12312 raft_consensus.cc:686] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [term 1 LEADER]: Becoming Leader. State: Replica: bcd50d8ba60b45ccb3955a120949efec, State: Running, Role: LEADER
I20260808 05:07:47.494803 12312 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } }
I20260808 05:07:47.495204 12312 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcd50d8ba60b45ccb3955a120949efec. Latest consensus state: current_term: 1 leader_uuid: "bcd50d8ba60b45ccb3955a120949efec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:47.495311 12312 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [sys.catalog]: This master's current role is: LEADER
W20260808 05:07:47.499042 12325 catalog_manager.cc:1558] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:07:47.499126 12325 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:47.499267 12338 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:47.499418 12338 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:07:47.501286 12244 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [term 1 FOLLOWER]: Refusing update from remote peer bcd50d8ba60b45ccb3955a120949efec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:47.502035 12336 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [LEADER]: Connected to new peer: Peer: permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:47.503381 12291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcd50d8ba60b45ccb3955a120949efec. Latest consensus state: current_term: 1 leader_uuid: "bcd50d8ba60b45ccb3955a120949efec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:47.503466 12291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:47.507140 12180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.492228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36544 (local address 127.11.70.253:33703)
0808 05:07:47.492266 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.492267 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.492500 (+ 233us) server_negotiation.cc:407] Connection header received
0808 05:07:47.492699 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.492700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.492710 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.492742 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.493599 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.494310 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.495820 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.496110 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.496153 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.503693 (+ 7540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.503694 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.503695 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.503701 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.505253 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.505882 (+ 629us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.505883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.505884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.505954 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.506188 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.506189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.506189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.506331 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.506421 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.506927 (+ 506us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.507013 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:07:47.507205 12074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.492013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58728 (local address 127.11.70.254:45209)
0808 05:07:47.492049 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.492050 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.492078 (+ 28us) server_negotiation.cc:407] Connection header received
0808 05:07:47.492213 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.492214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.492237 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.492268 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.493594 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.494277 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.495945 (+ 1668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.496262 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.496323 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.502862 (+ 6539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.502864 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.502864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.502872 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.504629 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.505994 (+ 1365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.505996 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.505996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.506072 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.506421 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.506422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.506422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.506593 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.506676 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.507017 (+ 341us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.507115 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:07:47.515053 12336 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bcd50d8ba60b45ccb3955a120949efec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:47.515149 12336 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:47.515755 12291 sys_catalog.cc:455] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bcd50d8ba60b45ccb3955a120949efec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:47.515843 12291 sys_catalog.cc:458] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:47.516108 12345 mvcc.cc:205] Tried to move back new op lower bound from 7316134574082224128 to 7316134574059454464. Current Snapshot: MvccSnapshot[applied={T|T < 7316134574082224128}]
I20260808 05:07:47.516253 12342 mvcc.cc:205] Tried to move back new op lower bound from 7316134574082224128 to 7316134574059454464. Current Snapshot: MvccSnapshot[applied={T|T < 7316134574082224128}]
I20260808 05:07:47.516271 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.495657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55550 (local address 127.11.70.252:33699)
0808 05:07:47.495694 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.495696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.500223 (+ 4527us) server_negotiation.cc:407] Connection header received
0808 05:07:47.500322 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.500323 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.500334 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.500363 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.507895 (+ 7532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.508662 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.510243 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.510594 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.510638 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.512758 (+ 2120us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.512760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.512760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.512768 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.514390 (+ 1622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.515072 (+ 682us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.515074 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.515074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.515141 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.515474 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.515475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.515476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.515602 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.515700 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.516033 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.516146 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:07:47.517009 12338 catalog_manager.cc:1347] Generated new cluster ID: ee8bd475906a48a186d38c562ea86b17
I20260808 05:07:47.517055 12338 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:47.526790 12176 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } attempt: 3
I20260808 05:07:47.526849 12338 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:47.527787 12338 catalog_manager.cc:1504] Loading token signing keys...
Aug 08 05:07:47 dist-test-slave-7kzw krb5kdc[11963](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165667, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.70.253@KRBTEST.COM for kudu/127.11.70.252@KRBTEST.COM
I20260808 05:07:47.535249 12178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.527057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.70.252:33699 (local address 127.0.0.1:55560)
0808 05:07:47.527106 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:47.527117 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:47.527159 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:47.527326 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:47.527327 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:47.527505 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:47.527552 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.527554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.528447 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.528448 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.529243 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:47.529245 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.529800 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.529801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:47.529872 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.530342 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:47.530347 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:47.531895 (+ 1548us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:47.533851 (+ 1956us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.533852 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.533853 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.534093 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.534344 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:47.534345 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:47.534345 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:47.534425 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:47.534902 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:47.534903 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:47.534965 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 05:07:47.535029 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 05:07:47.535141 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 05:07:47.535651 12288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:47.527109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55560 (local address 127.11.70.252:33699)
0808 05:07:47.527143 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.527145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.527153 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:07:47.527228 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.527229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.527241 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.527313 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.527638 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.528352 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.529355 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:47.529664 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:47.529726 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:47.532004 (+ 2278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:47.532005 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:47.532006 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:47.532013 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:47.533721 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.534187 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.534188 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.534189 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.534261 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:47.534571 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:47.534571 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:47.534572 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:47.534728 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:47.534774 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:47.535482 (+ 708us) server_negotiation.cc:299] Negotiation successful
0808 05:07:47.535562 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:07:47.536448 12338 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec: Generated new TSK 0
I20260808 05:07:47.536670 12338 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:07:47.537147 12176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d: Bootstrap starting.
I20260808 05:07:47.537899 12176 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:47.538224 12176 log.cc:824] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:47.539614 12176 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d: No bootstrap required, opened a new log
I20260808 05:07:47.541607 12176 raft_consensus.cc:348] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } }
I20260808 05:07:47.541749 12176 raft_consensus.cc:729] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a91262efe3414fb0b4aaba7a8afcc64d, State: Initialized, Role: FOLLOWER
I20260808 05:07:47.541822 12176 consensus_queue.cc:260] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } }
I20260808 05:07:47.542106 12351 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:47.542167 12176 sys_catalog.cc:564] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:47.542268 12139 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:47.542551 12141 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "bcd50d8ba60b45ccb3955a120949efec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a91262efe3414fb0b4aaba7a8afcc64d"
I20260808 05:07:47.543756 12351 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:47.546936 12139 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [term 1 FOLLOWER]: Refusing update from remote peer bcd50d8ba60b45ccb3955a120949efec: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:07:47.547300 12336 consensus_queue.cc:1035] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [LEADER]: Connected to new peer: Peer: permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:07:47.548274 12141 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bcd50d8ba60b45ccb3955a120949efec in term 1.
I20260808 05:07:47.550348 12351 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcd50d8ba60b45ccb3955a120949efec. Latest consensus state: current_term: 1 leader_uuid: "bcd50d8ba60b45ccb3955a120949efec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:47.550518 12351 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:07:47.550637 12351 sys_catalog.cc:455] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "bcd50d8ba60b45ccb3955a120949efec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:47.550804 12351 sys_catalog.cc:458] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:07:47.553570 12375 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:07:47.553673 12375 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:07:47.554324 12371 mvcc.cc:205] Tried to move back new op lower bound from 7316134574221578240 to 7316134574059454464. Current Snapshot: MvccSnapshot[applied={T|T < 7316134574082224128}]
W20260808 05:07:47.564874 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.563155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36558 (local address 127.11.70.253:33703)
0808 05:07:47.563199 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.563201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.564182 (+ 981us) server_negotiation.cc:407] Connection header received
0808 05:07:47.564289 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.564290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.564301 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.564333 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.564794 (+ 461us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36558: BlockingRecv error: recv got EOF from 127.0.0.1:36558 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 05:07:47.565644 12074 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.563549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58740 (local address 127.11.70.254:45209)
0808 05:07:47.563597 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.563599 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.565126 (+ 1527us) server_negotiation.cc:407] Connection header received
0808 05:07:47.565225 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.565226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.565238 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.565268 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.565578 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58740: BlockingRecv error: recv got EOF from 127.0.0.1:58740 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 05:07:47.566504 12288 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.563884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55574 (local address 127.11.70.252:33699)
0808 05:07:47.563940 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.563942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.565854 (+ 1912us) server_negotiation.cc:407] Connection header received
0808 05:07:47.566014 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.566015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.566026 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.566055 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.566404 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:55574: BlockingRecv error: recv got EOF from 127.0.0.1:55574 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 05:07:47.568845 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.568079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36562 (local address 127.11.70.253:33703)
0808 05:07:47.568124 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.568125 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.568371 (+ 246us) server_negotiation.cc:407] Connection header received
0808 05:07:47.568479 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.568480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.568497 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.568525 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.568800 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36562: BlockingRecv error: recv got EOF from 127.0.0.1:36562 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 05:07:47.571949 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.571005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36574 (local address 127.11.70.253:33703)
0808 05:07:47.571051 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.571052 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.571305 (+ 253us) server_negotiation.cc:407] Connection header received
0808 05:07:47.571568 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.571570 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.571580 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.571611 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.571905 (+ 294us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36574: BlockingRecv error: recv got EOF from 127.0.0.1:36574 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
W20260808 05:07:47.575695 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.574957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36590 (local address 127.11.70.253:33703)
0808 05:07:47.574989 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.574991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.575228 (+ 237us) server_negotiation.cc:407] Connection header received
0808 05:07:47.575321 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.575322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.575332 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.575363 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.575655 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36590: BlockingRecv error: recv got EOF from 127.0.0.1:36590 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 05:07:47.581527 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.580718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36606 (local address 127.11.70.253:33703)
0808 05:07:47.580752 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.580754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.580980 (+ 226us) server_negotiation.cc:407] Connection header received
0808 05:07:47.581066 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.581067 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.581116 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.581162 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.581484 (+ 322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36606: BlockingRecv error: recv got EOF from 127.0.0.1:36606 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 05:07:47.591650 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.590712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36622 (local address 127.11.70.253:33703)
0808 05:07:47.590756 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.590758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.591063 (+ 305us) server_negotiation.cc:407] Connection header received
0808 05:07:47.591185 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.591186 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.591198 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.591227 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.591593 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36622: BlockingRecv error: recv got EOF from 127.0.0.1:36622 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 05:07:47.610234 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.609143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36638 (local address 127.11.70.253:33703)
0808 05:07:47.609188 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.609190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.609506 (+ 316us) server_negotiation.cc:407] Connection header received
0808 05:07:47.609619 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.609620 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.609633 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.609665 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.610168 (+ 503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36638: BlockingRecv error: recv got EOF from 127.0.0.1:36638 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 05:07:47.644610 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.643649 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36648 (local address 127.11.70.253:33703)
0808 05:07:47.643694 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.643697 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.644004 (+ 307us) server_negotiation.cc:407] Connection header received
0808 05:07:47.644120 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.644122 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.644134 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.644164 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.644547 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36648: BlockingRecv error: recv got EOF from 127.0.0.1:36648 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 05:07:47.711004 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.710084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36652 (local address 127.11.70.253:33703)
0808 05:07:47.710178 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.710180 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.710230 (+ 50us) server_negotiation.cc:407] Connection header received
0808 05:07:47.710301 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.710302 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.710318 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.710422 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.710922 (+ 500us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36652: BlockingRecv error: recv got EOF from 127.0.0.1:36652 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 05:07:47.840903 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:47.840150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36668 (local address 127.11.70.253:33703)
0808 05:07:47.840245 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:47.840247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:47.840301 (+ 54us) server_negotiation.cc:407] Connection header received
0808 05:07:47.840351 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:47.840352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:47.840362 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:47.840416 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:47.840831 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36668: BlockingRecv error: recv got EOF from 127.0.0.1:36668 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
I20260808 05:07:48.092644 12336 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "bcd50d8ba60b45ccb3955a120949efec" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bcd50d8ba60b45ccb3955a120949efec" member_type: VOTER last_known_addr { host: "127.11.70.254" port: 45209 } } peers { permanent_uuid: "a91262efe3414fb0b4aaba7a8afcc64d" member_type: VOTER last_known_addr { host: "127.11.70.253" port: 33703 } } peers { permanent_uuid: "461db43bb96a4fa2aed74d2cc3bc59f2" member_type: VOTER last_known_addr { host: "127.11.70.252" port: 33699 } } }
I20260808 05:07:48.092839 12336 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcd50d8ba60b45ccb3955a120949efec [sys.catalog]: This master's current role is: LEADER
W20260808 05:07:48.099087 12180 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:07:48.098291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36670 (local address 127.11.70.253:33703)
0808 05:07:48.098364 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:48.098366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:48.098396 (+ 30us) server_negotiation.cc:407] Connection header received
0808 05:07:48.098519 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:48.098520 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:48.098537 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:48.098592 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:48.098991 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36670: BlockingRecv error: recv got EOF from 127.0.0.1:36670 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:07:48.484880 12305 catalog_manager.cc:1259] Loaded cluster ID: ee8bd475906a48a186d38c562ea86b17
I20260808 05:07:48.484994 12305 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2: loading cluster ID for follower catalog manager: success
I20260808 05:07:48.485832 12305 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2: acquiring CA information for follower catalog manager: success
I20260808 05:07:48.486181 12305 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 461db43bb96a4fa2aed74d2cc3bc59f2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:07:48.554181 12375 catalog_manager.cc:1259] Loaded cluster ID: ee8bd475906a48a186d38c562ea86b17
I20260808 05:07:48.554268 12375 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d: loading cluster ID for follower catalog manager: success
I20260808 05:07:48.555163 12375 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d: acquiring CA information for follower catalog manager: success
I20260808 05:07:48.555449 12375 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a91262efe3414fb0b4aaba7a8afcc64d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:07:48.615543 12467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:48.612446 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36676 (local address 127.11.70.253:33703)
0808 05:07:48.612652 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:48.612654 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:48.612715 (+ 61us) server_negotiation.cc:407] Connection header received
0808 05:07:48.612771 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:48.612772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:48.612828 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:48.612912 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:48.613132 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.613666 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.614587 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.614813 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.614880 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:48.615113 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:48.615233 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:48.615298 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:48.615404 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 05:07:48.615423 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":86,"threads_started":1}
I20260808 05:07:48.620270 12475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:48.617673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55582 (local address 127.11.70.252:33699)
0808 05:07:48.617793 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:48.617796 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:48.617804 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:07:48.617845 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:48.617845 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:48.617894 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:48.617973 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:48.618140 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.618701 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.619449 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.619661 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.619722 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:48.619900 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:48.620004 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:48.620064 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:48.620130 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 05:07:48.620147 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":70,"threads_started":1}
I20260808 05:07:48.625504 12475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:48.622275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55592 (local address 127.11.70.252:33699)
0808 05:07:48.622318 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:48.622320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:48.622676 (+ 356us) server_negotiation.cc:407] Connection header received
0808 05:07:48.622732 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:48.622733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:48.622745 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:48.622800 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:48.622972 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.623671 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.624692 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.624963 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.625062 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:48.625229 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:48.625261 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:48.625313 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:48.625394 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 05:07:48.625415 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:07:48.625982 12485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:48.622286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58756 (local address 127.11.70.254:45209)
0808 05:07:48.622924 (+ 638us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:48.622943 (+ 19us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:48.622951 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:07:48.622997 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:48.622998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:48.623058 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:48.623144 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:48.623230 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.623949 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.624741 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.625100 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.625154 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:48.625365 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:48.625610 (+ 245us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:48.625688 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:48.625863 (+ 175us) server_negotiation.cc:299] Negotiation successful
0808 05:07:48.625892 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":619,"thread_start_us":54,"threads_started":1}
I20260808 05:07:48.626384 12467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:48.622288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36688 (local address 127.11.70.253:33703)
0808 05:07:48.622330 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:48.622333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:48.622842 (+ 509us) server_negotiation.cc:407] Connection header received
0808 05:07:48.622876 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:48.622877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:48.622889 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:48.622953 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:07:48.623897 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.624620 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.625556 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:48.625879 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:48.625945 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:48.626129 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:07:48.626161 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:07:48.626199 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:48.626269 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 05:07:48.626290 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:07:48.627882 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 11981
I20260808 05:07:48.642592 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 12082
I20260808 05:07:48.653143 11547 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJXTM0Z/build/release/bin/kudu with pid 12191
2026-08-08T05:07:48Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3054 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6113 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (282424 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST